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Abstract 

General aspects of the Fluctuation-Dissipation Relation (FDR), and Response The- 
ory are considered. After analyzing the conceptual and historical relevance of fluc- 
tuations in statistical mechanics, we illustrate the relation between the relaxation of 
spontaneous fluctuations, and the response to an external perturbation. These stud- 
ies date back to Einstein's work on Brownian Motion, were continued by Nyquist 
and Onsager and culminated in Kubo's linear response theory. 

The FDR has been originally developed in the framework of statistical mechanics 
of Hamiltonian systems, nevertheless a generalized FDR holds under rather general 
hypotheses, regardless of the Hamiltonian, or equilibrium nature of the system. In 
the last decade, this subject was revived by the works on Fluctuation Relations 
(FR) concerning far from equilibrium systems. The connection of these works with 
large deviation theory is analyzed. 

Some examples, beyond the standard applications of statistical mechanics, where 
fluctuations play a major role are discussed: fluids, granular media, nano-systems 
and biological systems. 
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To the memory of Robert H. Kraichnan (1928-2008), 

whose conspicuous and remarkable achievements include 
fundamental contributions to the subject of our review. 



1 Introduction 

1.1 Introductory remarks and plan of the paper 

Recent developments in non equilibrium statistical physics have convinced us 
that times are ripe for a review of the vast subject concerning the fluctuations 
of systems described by statistical mechanics. This issue is important even 
beyond the "traditional" applications of statistical mechanics, e.g. in a wide 
range of disciplines ranging from the study of small biological systems to tur- 
bulence, from climate studies to granular media etc. Moreover, the improved 
resolution in real experiments and the computational capability reached in 
numerical simulations has led to an increased ability to unveil the detailed 
nature of fluctuations, posing new questions and challenges to the theorists. 

One of the most important and general results concerning systems described 
by statistical mechanics is the existence of a relation between the spontaneous 
fluctuations and the response to external fields of physical observables. This 
result has applications both in equilibrium statistical mechanics, where it is 
used to relate the correlation functions to macroscopically measurable quan- 
tities such as specific heats, susceptibilities and compressibilities, and in non 
equilibrium systems, where it offers the possibility of studying the response to 
time dependent external fields, by analyzing time-dependent correlations. 

The idea of relating the amplitude of the dissipation to that of the fluctua- 
tions dates back to Einstein's work on Brownian motion. Later, Onsager put 
forward his regression hypothesis stating that the relaxation of a macroscopic 
nonequilibrium perturbation follows the same laws which govern the dynamics 
of fluctuations in equilibrium systems. This principle is the basis of the FDR 
theorem of Callen and Welton, and of Kubo's theory of time dependent corre- 
lation functions. This result represents a fundamental tool in non-equilibrium 
statistical mechanics since it allows one to predict the average response to ex- 
ternal perturbations, without applying any perturbation. In fact, via an equi- 
librium molecular dynamics simulation one can compute correlation functions 
at equilibrium and then, using the Green-Kubo formula, obtain the transport 
coefficients of model liquids without resorting to approximation schemes. 
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Although the FDR theory was originally applied to Hamiltonian systems near 
thermodynamic equilibrium, it has been realized that a generalized FDR holds 
for a vast class of systems with chaotic dynamics of special interest in the study 
of natural systems, such as geophysics and climate. 



A renewed interest toward the theory of fluctuations has been motivated by 
the study of nonequilibrium processes. In 1993 Evans, Cohen and Morriss 
considered the fluctuations of the entropy production rate in a shearing fluid, 
and proposed the so called Fluctuation Relation (FR). This represents a gen- 
eral result concerning systems arbitrarily far from equilibrium. Moreover it 
is consistent with the Green-Kubo and Onsager relations, when equilibrium 
is approached. Starting with the developments of the FR proposed by Evans 
and Searles and, in different conditions, by Gallavotti and Cohen, continuing 
with the Crooks and Jarzynski relations, and the recent works by Derrida and 
coworkers and Jona-Lasinio and coworkers on dynamical path probabilities, 
the last 10-15 years have produced a whole new theoretical framework which 
encompasses the previous linear response theory and goes beyond that, to in- 
clude far from equilibrium phenomena, such as turbulence and the dynamics 
of granular materials. 



In this paper, we only consider systems which are ergodic and have an invariant 
phase space distribution, which is reached in physically relevant time scales. 
Therefore, we do not discuss aging and glassy behaviours. For such interesting 
issues the reader is referred to recent reviews [1,2,3]. 



This review is organized as follows. In this section we give a brief historical 
overview on the origin of FDR, in particular of its relevance to the "proof" 
of the existence of atoms. In Section 2 we present the classical fundamen- 
tal contributions of Onsager and Kubo to the general theory of FDR. The 
third Section is devoted to a discussion of FDR in chaotic systems. It is 
shown that a generalized FDR holds under rather general conditions, even 
in non- Hamiltonian systems, and in non-equilibrium situations. In addition, 
we discuss the connection between this FDR and the foundations of statistical 
mechanics, and anomalous diffusion. Section 4 treats non-standard applica- 
tions of the FDR: fluid dynamics, climate, granular materials and biophysical 
systems. The different approaches to the FR are discussed in Section 5. In Sec- 
tion 6 we discuss the numerical and experimental investigations of the FR in 
stochastic systems, granular gases and conducting systems. Section 7 concerns 
the seminal work of Onsager and Machlup, and the recent results in extended 
non-equilibrium systems, in terms of large deviations theory. Four Appendices 
conclude the paper. 
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1.2 Historical overview 



The study of the fluctuations, and of their relation with the response to exter- 
nal perturbations, has an important conceptual and historical relevance, apart 
from its technical interest which is now universally recognized. Therefore we 
give a brief overview of Statistical Mechanics at the beginning of the 20-th 
century 

1.2.1 Fluctuation Phenomena and Atoms 

In spite of the great successes of the atomistic hypothesis in chemistry and 
kinetic theory, towards the end of the 19-th century, some influential scien- 
tists such as Ostwald and Mach still claimed that it was possible to avoid 
the atomistic perspective in the descriptions of nature. Indeed, there was no 
unquestionable evidence of the existence of atoms at that time. The atomic 
theory plays a role in physics similar to that of certain auxiliary concepts in 
mathematics; it is a mathematical model for facilitating the mental reproduc- 
tion of facts [4], was stated by Mach. 

Even Boltzmann and Gibbs, who already knew the expression for the mean 
square energy fluctuation, correctly thought that fluctuations would be too 
small to be observed in macroscopic systems: In the molecular theory we as- 
sume that the laws of the phenomena found in nature do not essentially deviate 
from the limits that they would approach in the case of an infinite number of 
infinitely small molecules [5]. 

... [the fluctuations] would be in general vanishing quantities, since such expe- 
rience would not be wide enough to embrace the more considerable divergences 
from the mean values [6]. 

One of the reasons of Einstein's and Smoluchowski's interest for statistical 
mechanics was to find conclusive evidence for the atomic hypothesis. At vari- 
ance with the ideas of Boltzmann and Gibbs, their efforts attributed a central 
role to the fluctuations. The equation we finally obtained (eq. 1.11) would 
yield an exact determination of the universal constant (i.e. the Avogadro 
number), if it were possible to determine the average of the square of the energy 
fluctuation of the system; this is however not possible according our present 
knowledge [7]. 

1.2.2 Brownian motion: a macroscopic window on the microscopic world 

Einstein's hope came true in the understanding of a "strange" phenomenon: 
the Brownian motion (BM). In 1827 the Scottish botanist Robert Brown no- 
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ticed that pollen grains suspended in water jiggled about under the lens of the 
microscope, following a zigzag path. Initially, he believed that such an activity 
was peculiar to the male sexual cells of plants; further study revealed that the 
same motion could be observed even with chips of glass or granite or particles 
of smoke. For some decades such a phenomenon was considered as a sort of 
curiosity, although the BM attracted the interest of important scientists, such 
as Poincare [8]. 

The breakthrough in the understanding of the BM is due to the indepen- 
dent works by Einstein [9,10] and Smoluchowski [11] at the beginning of the 
20th century. A few years later, Langevin proposed an approach in terms of a 
stochastic differential equation, which takes into account the effect of molec- 
ular collisions by means of an average force, given by the fluid friction, and of 
a random fluctuating term [12]. 

The experimental works by Perrin and Svendborg on the BM can be considered 
as the first "proof" of the existence of atoms, while Langevin's equation, which 
has been the first example of stochastic differential equation, inspired the 
mathematical theory of continuous time stochastic processes. 

The basic physical assumptions in both Einstein's and Langevin's approaches 
are: 

a) Stokes' law for the frictional force exerted on a body moving in a liquid; 

b) the equipartition of kinetic energy among the degrees of freedom of the 
system, i.e. between the particles of the fluid and the grain performing BM. 

A colloidal particle suspended in a liquid at temperature T is thus assimi- 
lated to a particle of the liquid, so that it possesses an average kinetic energy 
RT/{2Na), in each spatial direction, where R is the perfect gas constant and 
Na is the Avogadro number. Accordingly, one obtains: 



According to Stokes' law, a spherical particle of radius a, moving in a liquid 
with speed V in the x direction, experiences a viscous drag force: 



where rj is the viscosity. This law holds if a is much larger than the average 
distance between the liquid molecules, in which case Stokes' force (fs) repre- 
sents the average macroscopic effect of the irregular impacts of the molecules 
of the fluid. 




RT 




2Na 



fs — —aV — —dnrjaV , 
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Therefore, isolating the average force, the dynamical equation of the particle 
in the x direction can be written as 



where fR{t) is a random fluctuating force mimicking the effects of the impact 
of the molecules on the particle. Of course = 0, and its characteristic 

time, being determined by the collisions of the molecules of the liquid with 
the colloidal particle, is much smaller than r = m/a. One can then assume 
that Jr is a Gaussian stochastic process with {f R{t) f ^{t')) = c5{t — f), where 
c can be determined by the energy equipartition. Elementary computations 
give [13] 



2RT 



ccNa 



{[x{t) - x{m = ^ ^ - - (1 - e-^*) . (1.3) 



a 



For a grain of size 0(l/i), in a common liquid (such as water) at room tem- 
perature, the characteristic time r = m/a — m/dTrrja is O{10~^s). For t ^ t, 
we get 

<w')-(o)n-^*-5|^«. (1.4) 

This leads to the celebrated Einstein relation for the diffusion coefficient D, 
in terms of macroscopic variables and of the Avogadro number: 

o=,,^m^im=^. (1.5) 

Let us stress that (1.5) allows the determination of the Avogadro number (a 
microscopic quantity) from experimentally accessible macroscopic quantities, 
thus providing a non ambiguous link between the microscopic and macroscopic 
levels of description, in physics. 

The theoretical work by Einstein and the experiments by Perrin gave a clear 
and conclusive evidence of the relationship between the diffusion coefficient 
(which is measurable at the macroscopic level) and the Avogadro number 
(which is related to the microscopic description) [14]. Such a result could 
be considered as a "proof" of the existence of atoms: after that, even two 
champions of the energetic point of view, like Helm and Ostwald, accepted 
atomism as a physical fact and not as a mere useful hypothesis. In a lecture 
in Paris, in 1911, Arrhcnius, summarizing the works of Einstein and Perrin, 
declared after this, it does not seem possible to doubt that the molecular theory 
entertained by the philosophers of antiquity, Leucippus and Democritos, has 
attained the truth at least in essentials [8]. 

Although Langevin's approach, like Einstein's, is, from a mathematical point 
of view, rather simple, there is a very subtle conceptual point at the basis of 
his theory of the Brownian motion. The ingenious idea is the assumption of 
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the validity of Stokes law (which has a macroscopic nature), together with 
the assumption that the Brownian particle is in statistical equilibrium with 
the molecules in the liquid. In other words, in spite of the fact that the mass 
of the colloidal particle is exceedingly larger than the mass of the molecules, 
energy equipartition is assumed to hold. 



1.3 Fluctuations in equilibrium statistical mechanics 

Equihbrium statistical mechanics predicts both the average value of the ther- 
modynamic observables and the size of their fluctuations about their equilib- 
rium values. In this section, we briefly report the salient features of the theory 
of fluctuations of extensive thermodynamic variables. 

Let us consider a large isolated system in thermodynamic equilibrium, and 
single out a small region representing the subsystem of interest (here named 
S), while the rest of the system constitutes a reservoir (R). Suppose that, due 
to the coupling with R, the extensive variable X of the system S can fluctuate 
about its equilibrium value, while the remaining extensive variables are held 
fixed. The probability of observing a fluctuation of size smaller than a value 
Xq is given by the canonical distribution function: 

P{X < Xo) = e-^^'*) e-''^dN{X) (1.6) 

where h is the intensive thermodynamic field conjugated to X, N{X) is the 
cumulative number of microstates with X < Xq, and the integral is to be inter- 
preted in the Riemann-Stieltjes sense if the spectrum has also a discrete part. 
The function ip{h), which normalizes the distribution function, is determined 
by the condition 

gVW ^ / e-''''dN{X) (1.7) 

J—oo 

and represents a thermodynamic potential. The function iplh) is a Legendre 
transform of the entropy, or generahzed Massieu function [15]. Note that, 
even if this argument is formal and therefore of general validity, when X is 
an extensive observable of a macroscopic system (i.e. in the thermodynamic 
limit) the function ijj{h), or better its Legendre transform, can be seen in terms 
of large deviations theory, see Appendix B. 

If we consider the characteristic function: 

/oo 
e-('^-")^(iiV(X) = e^^'^-'^^e-^^^^ (1.8) 
-oo 

and expand ip{h — a) with respect to a, we obtain the cumulants, (X")c, of 
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the distribution 



in(^"^> - E = E ■ (1-9) 



n=i ^! ^! dh"" 



As an important example, we consider the energy fluctuations in a system S, 
at constant temperature. In this case X = E, h = (3~^ and ip{h) = —PA{(3), 
where A is the Helmholtz free energy. By employing eq. (1.9) and using stan- 
dard thermodynamic relations, we obtain the following results: 



{E),^{E) = -^{PAm = U (1.10) 

(^^.(^V(^)^ = ^^ = -|-^-.T^^. (1.11) 

{E\^ {E') - 3{E){E') + 2{Ef = - ^'^^^ (1.12) 

= 4r^[2Cv + r^]. (1.13) 

Formulae (1.10)-(1.13) are a manifestation of the relation between the fluctua- 
tions of the quantity X and the variations of the thermodynamic potential -0, 
with respect to the conjugate field h. The generahzation to several extensive 
variables Xi, X2.., X,. is straightforward and involves the generalized potential 
defined by 0(/ii, /i2, h^) 

^4>{hiM,..,hr) ^ j .. j dXi..(iX^e('*i^i+--+'*'-^'-)(iX(Xi, .., X^) (1.14) 



(exp ^ ajXj) = e-<t>ihiM,-M j j dX^ jx^ exp ^E(«j " hj)X^ dN{Xi, ., X, 



(1.15) 



{Xj,= -^iP{hi,..,hr) (1.16) 

(X„X,), = ij{h,, .., hr) . (1.17) 

dhrr,.Ohn 



Let us, now, consider the problem of relating the properties of a system whose 
Hamiltonian is 7Y(P, Q) = 7Yo(P, Q) + ^A(P, Q) to those of a similar system 
characterized by 7Yo(P,Q) only, where P = (pi, Pat), Q = (qi, qjv). If 
the perturbation induced by XA{P, Q) is small, the canonical distribution of 
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the system with A 7^ is to hnear order given by: 

..p ^ exp(-/?7i) exp(-/?Ho) l-A^P.Q) 

■'^ '^^ JdPdQexp{-pn) JdPdQexp{-pno) 1 - A/3(A(P, Q))^ 

(1.18) 

or 

/(P, Q) = /o(P, Q) (1 - A/? [A(P, Q) - {A{P, Q))o] ) (1.19) 

where ()o stands for the average relative to the system with A = 0. The 
corresponding average change of a generic observable i?(P,Q), induced by 
the perturbation, is to the same order: 

(AB)o~ / ciPciQS(P,Q)(/(P,Q)-/o(P,Q)) 

~-A/3 1 rfPdQS(P,Q)(^(P,Q)-(^(P,Q))o))/o(P,Q)) 
^-xi{{BA),-{B),{A),) . (1.20) 

The last formula shows that the change of the observable B is related to the 
equilibrium pair correlation of B with the perturbation A. With the choice 
S(P, Q) = ^(P, Q) = Ho we obtain: 

^ = fSi^ = - -'^''T'Cv (1.21) 

hence we connect the heat capacity, i.e. the response to an energy perturbation, 
to the energy fluctuations. 

Another relevant instance of the equilibrium fluctuation-response theorem is 
the relation between the correlation function r(r, r') (defined below) and the 
isothermal susceptibility XT{r,r')- In this case one considers the Hamiltonian 
to be a functional of the magnetization density m(r): 

n{m{r)) = 'Ho{m{r)) - j drh{r)m{r) (1.22) 

By using formula (1-20) with B = m{r) and XA = J dr'h{r')m{r') we find: 

XT(r, r') = /3[(m(r)m(r'))o - (m(r))o(m(r'))o] = /3r(r, r') . (1.23) 



1.4 Fluctuations in non- equilibrium statistical mechanics: the Einstein rela- 
tion between diffusion and mobility 



We already discussed the BM and its historical relevance for the atomic hy- 
pothesis and the development of the modern theory of stochastic processes. 
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In addition, in the celebrated paper of Einstein one can find the first exam- 
ple of FDR. Let us write the Langevin equation for the colloidal particle in 
"modern" terms 

where ^ — a/m and 77 is a white noise, i.e. a Gaussian stochastic process with 
< r]{t) >= and < r){t)r){t') >= 5{t - t'). The time correlation of V is 



Cvv{t) =< V{t)V{0) >=< > e 



-7t 



an easy computation gives 

roo 

D = / Cvv{t)dt . 
Jo 

Consider now a small perturbing force f{t) = FQ{t), where Q{t) is the Heav- 
iside step function. The average response of the velocity after a long time (i.e. 
the drift) to such a perturbation is given by: 

< - . (1.25) 

7 

Defining the mobility /i as: 



< SV >= nF 



one easily obtains the celebrated Einstein relation 

D 

which gives a link between the diffusion coefficient (a property of the unper- 
turbed system) and the mobility, which measures the system's reaction to a 
small perturbation. This constitutes the first example of FDR. 



2 The classical lineeir response theory 



2. 1 Hamiltonian formulation of the FDR 



In this section wc recall the derivation of Kubo's formula, which holds in the 
case of equilibrium dynamics [16]. Let us consider a system described by the 
Hamiltonian 7i(P,Q,t) = 7io(P,Q) - J^(t)A(P,Q), where 7io(P,Q) is the 
time-independent part. The evolution is governed by the Hamilton equations: 
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dt dpj dpj dp- " ^"^""-^ 



T{t)^ = ^ - Ht)K' (2.1) 



+ T{t)^ = - J'{t)Kl (2.2) 



9i dqj dqj dqj 



where we have introduced the "generahzed forces" 

dA dA 



The associated F-phase space probabihty distribution evolves according to the 
Liouville equation: 

^/(P, Q, t) + z[£o + >Ce.*(i)]/(P, Q, t) = (2.4) 

where £0 and Cext are the Liouville operators relative to the unperturbed 
Hamiltonian and to its perturbation respectively. These can be expressed by 
means of Poisson brackets as: 

.£./ = {/.W.} = Ef?^^-?^f)/ (2.8) 

j\dpjdqj dqj dp j) 

icut)f = -mu, A) = -m E (^|- - / . (2.6) 

We assume that the system is in thermal equilibrium at i = to, when 7i — 
Ho, and its statistical properties are described by the canonical equilibrium 
distribution, /(P,Q,to) = /eg(P, Q), satisfying the equation i£o/eg(PjQ) = 
0. Switching on the perturbation, we obtain an approximate solution of (2.4), 
in the form: 

/(P, Q, t) = /e,(P, Q) - i r di'e-^(*-*')^°£ext(i')/e,(P, Q) + ■ ■ ■ (2-7) 

Jto 

which is vaUd to first order in iCf.xt{t)- Using eq. (2.7), wc can compute, to 
hnear order in T{t), the ensemble average of an arbitrary function i?(P,Q) 
of the phase space variables (P, Q), at time t, as follows: 

{B{t)) = j dPdQS(P, Q)/(P, Q, t) (2.8) 

so that its change with respect to the equilibrium value is: 

(AS(t)) = {B{t)) - {B{t = to)) = 

- i I dPdQB{P, Q) £ (it'e-^(*-*')^°£e.t(t')/e,(P, Q) ■ (2.9) 
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Substituting, we find 

{AB{t)) = J dPdQB{P,q) f dt'e-<'-'"^''°J^{t'){feg,A}. (2.10) 

Using (2.6) and the fact that feq(P, Q) depends on (P, Q) only through Hq, 
we write: 

{AB{t))= fjt'T{t') I dP(iQ5(P,Q)e-^(*-*')^°{^o,^}^/e,(Ho(P,Q)). 



(2.11) 

A} = — ^ we car 



Since ^/,^(?io(P, Q)) = -/3/e,(Ho(P, Q)) and {Ho, A] = -f we can write 



{AB{t))=pJ^ dt'J^if) J rfPrfQi?(P,Q)e-*(*-*')^°-A(P,Q)i=o/e,(P,Q) • 

(2.12) 

Finally, using the unitarity of the Liouvillian operator, we find: 

{AB{t))^f5 jjt'T{t') j dPdQ|^(P,Q),=,Je.(P,Q)e^^*-*')^°S(P,Q). 

(2.13) 

If we introduce the response function, R{t), through the relation 

{AB{t)) = f dt'R{t - t')T{t'), (2.14) 

we may write 

R{t)^pJ dPdQ^A(P,Q)i=o/e5(P,Q)e'^*-*')^°S(P,Q) =/3(i(io)S(i)) 

(2.15) 

which can also be rewritten as 

Kit) = -P{Aito)Bit)) . (2.16) 

For later comparison, we can express the response function in a different guise, 
by defining the dissipative flux J(P, Q) 

J(P, Q)/e,(P, Q) = -{Ho, A}UF, Q) = - E (^^I + ^^j) /e.(P, Q) 

-i:{K]F^''-Kf£jfe,{P,Q) (2.17) 

where wc have introduced the force acting on the j-th particle, due to the 
Hamiltonian Ho, as Fj'^^ = Using (2.17) we may write: 

R{t) ^-pj dPdQJ(P,Q)/e,(P,Q)e^(*-*')^°S(P,Q) = -P{J{to)B{t)) . 

(2.18) 
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2.2 Green-Kubo relations 



2.2.1 Diffusion 

In order to probe the diffusive properties of a system of particles, we apply 
a spatially uniform force h along an arbitrary direction, say the x-direction, 
and consider how the induced change of the average velocity depends on the 
external field. Due to the mutual interactions among the particles, this average 
velocity reaches a stationary value, because the drift current caused by the field 
is balanced by the diffusion current. 

In order to achieve such a situation, we add the following perturbation to the 
Hamiltonian: 

^(P,Q) = -/i^?J (2.19) 

3 

SO that the dissipative flux, introduced above, turns out to be: 

J(P,Q) = -A^pJ. (2.20) 
m ^ ■' 

We, now, compute the change of the average velocity along the x-direction, 
i.e. we set -B(P,Q) = C/cc(P,Q) = ^EjPj- By applying formula (2.18) we 
have 

(At/,(t)) = ( di!T{i!) [ dPrfQJ(P,Q)e-*(*-*')^«t/,(P,Q)/e,(P,Q) 

Jto J 

(2.21) 

or 



fdt'mE{pmpiit-t'))^- (2-22) 

TTT' Jto jk 

We, now, set J-'{t') = 1 for t' > 0, to = and take into account the fact 
that the momenta of different particles are not correlated in the equilibrium 
system: 

i^UAt)) = [ dt' E (^{t,)p^{t - t'))^^ . (2.23) 

At this stage, we connect the self-correlation function to the mobility, ji, 
through the relation (A[4(i)) — /J'h, to conclude that 

= ^^'Efe(0)pJ(O),^- (2.24) 
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Finally we obtain the diffusion constant from the Einstein relation D — jj,/ (3. 



2.2.2 Shear flow 

Let us now discuss how to calculate the coefficient of the shear viscosity. 
Assume the following form of the perturbation operator: 

^(P,Q)-|E(9K + ?M) (2-25) 

3 

where 7 is the shear rate. The Hamiltonian with the above perturbation gen- 
erates the following equations of motion: 



M = + f = 5l+„| (2.26) 

at m ■' at m ■' 



^=^^-7Pf; ^ = ^^-7Pj (2.27) 

which are known as unthermostatted SLLOD equations describing a sheared 
fluid [17]. 

In this case the dissipative flux is: 

^(P, Q) = i E i^Pp' + + (2-28) 
and turns out to be proportional to the xy component of the pressure tensor 



3 



P^' = ^T. [-PlP'3 + + ^1^' ) (2-29) 



via the relation J(P, Q) = 7l^P^^, where V is the volume of the system. By 
following steps similar to those leading to (2.24) we obtain 

(AP-f (i)) = -13 1^ dt' I dPdQ J(P, Q)e-^(*-*')^°P^^(P, Q)/e,(P, Q) 

= -p-fV f dt' (P"nO)P^^(t'))e, , (2.30) 

J 

where again we have used (2.18) and T{t') = 1 for t' > 0. 
Finally using the definition of the shear viscosity rj 

77 = - lim ^ ^ 2.31 

t— »oo ^ 

we obtain: _ 

POO 

r]^(3V dt' (P''^(0)P^2/(^'))^^ . (2.32) 

•J 
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Eqs. (2.24) and (2.32) are just two examples of more general relations known as 
Green-Kubo relations, connecting the transport coefficients to the equilibrium 
two-time correlations of a system. 

A similar method is employed in order to derive relations for the thermal 
conductivity, A, and the bulk viscosity coefficient, k. The first of these relations 
reads: 

where 

S = i: {^Ph < >) ^ + i E E (q« • F« + t/(q«)) ^ (2.34) 

where < > is the enthalpy per particle, U{q^ij) is the pair potential and 
flij — fli — Qj- For details see [18]. 

Similarly, the bulk viscosity reads: 

1 poo . , 

''=Wk^l *'i:(«""(0)*J"(«')).,. (2.36) 



ab 



where a and b run over the spatial components, 

jab^YJ^ + Y. (itF- (2.36) 

j ^ 3 

and 

^jab^jab_^jaby (2.37) 



2.3 Linear Response for stochastic dynamics 



2.3.1 Langevin Dynamics 

Previously we discussed only Hamiltonian systems perturbed by a weak time- 
dependent external force. In the present section, we derive in a different fashion 
the FDR in systems subject to dissipative forces and random forces. Let us 
consider the following stochastic differential equation for the scalar variable 

^ = (-) 

where H[A{t)] is a function of A{t) and r] is a, white noise. 
We define the two-time correlation function as: 

C{t,t') = {A{t)A{t')) (2.39) 
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and assume without loss of generality t > t' . In order to calculate the response 
of the system to a time dependent external perturbation, we consider the 
following perturbation 

Hf,[A{t)\ = H[A{t)\ - h{t)A{t) . (2.40) 

The variation of the quantity A{t), induced by the presence of h{t), is measured 
by the two-time response function, R{t,t'), defined as 

The Fluctuation Dissipation theorem relates the two-time correlation function 
with the response function. Let us compute the following derivative of C{t, t'): 



dC{t, t') 



dH[A{t)] 



A{t') ) (2.42) 



dt 

and subtract the derivative with respect to the argument t': 

dC(t,t') dC(t,t') ,dH[A(t)] ,dH[A(t')] /..^./^^ 

(2.43) 

where we dropped a noise term because of causality. We use now the property, 
which is proved by Onsager's argument (cf. [19], pages 49-50): 

{A{t)B{t + r)) = {A{t)B{t - r)) = {A{t + r)B{t)) (2.44) 

the first equality derives from time reversal, the last equality follows from 
the invariance of the equilibrium state under a time translation t — > t + r. 
Therefore, the first two terms in the r.h.s. of eq. (2.43) cancel each other. 
Finally, the last term can be evaluated by means of Novikov's theorem [20] 
which states that if is a Gaussian process and is a function of A{t) then 

(2,45) 

Setting (yf(A(t)) = A{t) we obtain, using eq.(2. 41) and the property {r){t')rj{t")) - 
d{t'-t"), 

{A{tUt')) = I dt"R{t,t"){v{t"Ut')) = 2^TR{t,t') (2.46) 

and we find: 

dC(t,t') dC(t,t') ^ A , 

- = -2^TR{t, t') . (2.47) 

At equilibrium, the two-time average depends only on the time difference. 
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hence, setting t' — t + s, we must have: 

dC(t, t + s) 



dt 

or 



(2.48) 



^^{A{t)A{t + s)) = -§;{A{t)A{t + s)) (2.49) 



so that we have 

dC{t, t') dC{t, t') 



dt dt 
dC{t, t') 



(2.50) 



dt' 

We conclude that the response function has the form: 



7Ti?(t,t') . (2.51) 



R{t,t') = ^eit-t')^^^. (2.52) 



In order to connect this result with the static susceptibihty, we switch on a 
constant perturbation e at time t = 0, and compute the change induced on 
the variable A, which is given, using relation (2.41), by the formula 

{A(t)) - (A(0)) = 6 fdt'R(t,t') = e^[C(t,t) - C(t,0)] . (2.53) 
Jo ^1 

After defining the integrated response x by the formula: 

xM = \[C{t,t)-C{tM, (2.54) 

we can verify that its t — > oo limit coincides with the static response function 

Xst = ^[{A') - {Af] . (2.55) 

Here we have used the fact that the values of A at time t and at time become 
uncorrelated as t ^ oo and that the average factorizes. 



2.3.2 Linear Response in Fokker-Planck equation 

The probability distribution function of the process described by a stochastic 
differential equation evolves according to a Fokker-Planck equation. Within 
the Fokker-Planck formalism, we can generalize the method of section 2.1 to 
systems subjected to an average drift and a fluctuating term. 



In such a case, the distribution /(x, t) evolves according to: 

d_ 
di 



|/(x, t) = + jCrp{t)) /(x, t) (2.56) 
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where represents the Fokker-Planck operator of the unperturbed system, 
defined by 

Cl^fM = -E^. [Df\^)fM]+^d,d,Df^{^)fM (2.57) 

j jk 

where the functions D^^^ and D^^^ are related to the underlying Ito stochastic 
differential equations by 

^ = ^^(x) + Y^Mj,{^)n,{t), (2.58) 



and 



d|(x) = ^M,,(x)M,I(x) (2.59) 
where the white noise, 77^, is a Gaussian process with 

{rjk{t)) = 0, {Vj{t)vk{t')) = SjkS{t - t') . (2.60) 

We probe the response of the system, by adding an infinitesimal time-dependent 
perturbation of the form 

SDf{x, t) = J^{t)Kj{x) . (2.61) 

Such a perturbation induces the following change in the Fokker-Planck oper- 
ator: 

C^F%{t)f{^,t) = -J^{t)^d,{K,{^)f{^,t)) . (2.62) 

j 

We first determine the perturbed distribution, assuming that the system was 
stationary in the infinite past, i.e.: /(x, —00) = /st(x) and 

>C° pr*(x) = . (2.63) 

An approximate solution of the perturbed problem 

|/(x, t) = [jr,% + C^^%m{^, t) (2.64) 

to first order in the perturbation C^pp can be represented as: /(x, t) ~ /**(x)-|- 
A/(x, t), where A/ is formally given by: 

A/(x,t)=/* di'e(*-*')^°^^£^"i,(t')r*(x) . (2.65) 
J —00 

With this approximation, the deviation of the noise average of a physical 
quantity -B(x), due to the perturbation (2.61), can be written as: 

{AB{t)) = (S(x, t)) - (S(x, t = -00)) = J d^xS(x) A/(x, t) (2.66) 
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or, substituting eq. (2.65), 

{AB{t)) = /* dt' I ci^a;S(x)e^^^'(*-*')£f?^(i')/'*(x) (2.67) 

J —oo J 

compactly written as 

AS(t) = /* dt'R{t - t')T{t') (2.68) 

J— oo 

where the response function R{t — t'), for t > t' , reads: 

R{t) = - / d^xS(x)e^°-*^a,(X,(x)r(x)) (2.69) 

and R{t) = for t < 0, where (2.62) has been used. 

In order to relate the response function to the correlation in the unperturbed 
case, between two operators -B(x, t) and E(x',t'), defined as: 

{B{t)B{t')) ^ J J d^xdVS(x)S(x')M^2(x, t; x', t') (2.70) 

where W2i^,t;x.' ,t') is the joint probability distribution for the unperturbed 
case, we use the result: 

iy2(x, t; x', t') = P(x, t, x', t')f\x') = e^^^(*-*')(5(x - x')/'*(x') (2.71) 

where P(x, t, x',t') is the transition probability from configuration x' to x. 
Substituting such an expression in (2.70) we obtain 

{B{t)B{t')) = J d^x[e{t - t')P(x)e^^^(*-*')5(x) 

+ e{t' - i)S(x)e-^°^^'(*-*')S(x)] r*(x) . (2.72) 

Hence, provided we make the identification 

m = = --^E^.(^.Wr(x)) , (2.73) 

we can rewrite the response function as: 

R{t) =pj rf^a;5(x)e^'^.*^/-(x) = p (^B{t) J , (2.74) 

so that the analogy with the Hamiltonian formulation of the FDR is complete. 
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2.3.3 Kramers equation 



As an important special case, we consider the motion of a colloidal particle in 
an external field. To obtain a more useful expression and make contact with 
the FDR in Hamiltonian systems, we assume the Fokker-Planck equation to 
be of the form of a Kramers equation. Such stochastic dynamics can be con- 
sidered as a Hamiltonian dynamical system, in which the momentum equation 
is augmented by a friction and a noise term. Denoting x = (pj, qj), we have 



'^^^ + jr^t)K] (2.75) 



dt dp-i 

^ = - iPj + nm'; + ^^^^i^m ■ (2-76) 



The associated linear evolution operators are 

cv'At) = -Ht)Y.('<-S^^^K'^^) ■ (2.78) 

When J^{t) = the system has an equilibrium distribution /**(P,Q) — 
A/'exp(— /STYo), so that we may explicitly compute the expression: 



and 



Y: K,{P, Q)5,r*(P, Q) = + Kj^)r\P, Q) 

= /3(XjF,.-Kj^)r*(P,Q) (2.79) 

= J(P,Q)r(P,Q) (2.80) 

where the dissipative fiux J(P, Q) is identical to the one in Eq. (2.17). 

By comparing eq. (2.80) and (2.69) one sees that, for t > 0, R{t) can be 
expressed as the two-time correlation: 

R{t) = -/3 y d^xB{P, Q)e^"^^* J(P, Q)r*(P, Q) (2.81) 

which is similar to eq. (2.18), provided C'pp is replaced by — 
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2.3- 4 Smoluchowski equation 

The Smoluchowski equation can be considered the Fokker-Planck (FP) equa- 
tion which arises in the overdamped hmit, 7 ^ oo , of Langevin's equation 
(2.76): 

with r = 1/777.7. The associated FP equation reads: 

p{{q},t) = {£l + £rit))fm,t) (2.83) 

where £^ = dj{dj + pdjHo) and >C|^*(i) = -rT{t) E^- Kjdj. In this case 
we find that the current is determined by the following condition: 

= PK.Fjmq}) = J{{q})n{q}) (2.84) 

with f'\{q}) = .Mexp{-(3Ho'"^"'^{{q})). We conclude that in this case the 
response function is: 

R(t) ^-pj d^S({g})e^°«*J({?})r*({?}) . (2.85) 

2.4 Johnson-Nyquist spectrum and Onsager regression hypothesis 

Even before Onsager's and Kubo's great synthesis, important results had been 
obtained in some specific cases or under special conditions. Such contributions 
played a significant role in the development of statistical physics. In the fol- 
lowing we illustrate in detail some of them. 

2.4- 1 Frequency response and Johnson-Nyquist spectrum 

Equations (2.15)-(2.16), relating the response to a given perturbation and a 
suitable equilibrium correlation, is often useful in its frequency representation. 
If the external perturbation is periodic in time, 

:r(i) =Re[Koe^'^*], (2.86) 

because of linearity, the response reads 

(Ai?(t))=Re[x(u;)Koe^-*], (2.87) 
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where x{^) is the admittance defined as the Fourier transform of the response 
function R{t): 

/oo poo 
R{t) e^*^* dt = (3 {A{to)B{t)) e"^^* dt . (: 
-oo J to 



As an interesting example, we discuss the generahzed Langevin equation, with 
a retarded frictional force j{t): 



/■* 11 
= - / 7(t - t')u(t')dt' + —r]{t) + —Tit), t > to (2.89) 
Jtn m m 



du{t) 
dt J to 



where the external force is also included in this equation. The usual linear 
Langevin equation is the limiting case with ^{t) — ^5{t). It is immediate to see 
that the response of u{t) to a periodic perturbation of the form (2.86) reads 

(«(t))=Re[x(a;)Koe^'^*], (2.90) 

where the admittance is given by 

X(c^) = - . (2.91) 

with j{uj) the Fourier transform of 7(t). In other words, for a periodic pertur- 
bation, the admittance is analogous to the mobility. At equilibrium, JF = 0, 
the self-correlation of u{t) can be calculated, and its Fourier transform reads 

/■oo 1 

/ e-'^'{u{toHto + t))dt = (u^)——- (2.92) 
and therefore the FDR 

1 r°° 

X(a;) = — ^ / {u{to)u{to + t)) e— * dt (2.93) 
m{u'^) Jo 

is recovered. Note also that Eq. (2.92) allows us to calculate the power spec- 
trum of u{t) at equilibrium, i.e. 

S^iu) = r e-^-\u{to)u{to + t))dt = {u'') ..,^l^^l (2.94) 
J-00 [7(0;)]^ -I- tu^ 



A particular case of Eq. (2.89) is the equation governing the charge Q{t) 
contained in a condenser of capacity C, in a simple RC circuit without any 
externally applied electromotive force: 



24 



being r){t) a noisy internal electromotive force due to the interactions with a 
thermostat at temperature T. A series of experiments by Johnson [21], sup- 
ported by the theory of Nyquist [22] , demonstrated the existence of such spon- 
taneous fluctuations of electric tension at the edges of the resistor u — Q/C, 
due to the thermal motion of charge carriers. The measured quantity in the 
experiment was the power spectrum of these tension fluctuations, i.e. Su{oj). 
The above equation for the RC circuit can be written in the form 

du uit) ,, , , , 

with ri'it) = r]/RC. This is equivalent to Eq. (2.89) with 7(t) = ■^6{t), i.e. 
7(0;) = resulting in 

The energy of the capacitor is £■ = (5^/2C, and the equipartition of energy, re- 
quired at equilibrium, imposes that (E) = which yields (m^) = (Q^)/C^ = 
2{E)/C = ksT jC. This result, put into Eq. (2.97), gives the spectrum of the 
Johnson-Nyquist noise 

At low frequencies, u <^ 1/RC, the power spectrum becomes constant and 
does not depend on the capacity of the circuit: 

Su{uj) ~ 2RkBT. (2.99) 



For a modern linear response study of chaotic systems in frequency domain 
we refer the reader to [23]. 



2.4-2 The Onsager regression hypothesis 

In his two seminal papers of 1931 [24,25], Onsager presented his regression hy- 
pothesis: "... the average regression of fluctuations will obey the same laws as 
the corresponding macroscopic irreversible process^'' [25]. This principle states 
the equivalence between the law governing the relaxation of spontaneous devi- 
ations from equilibrium and the law obeyed by the corresponding irreversible 
process, which is triggered by an initial small deviation from equilibrium. The 
fluctuation-dissipation theorem (2.16), justifies this hypothesis in a natural 
way. 

Onsager referred to the relaxation of a macroscopic variable a{t) , an observable 
function of the microscopic degrees of freedom, a(P(t), Q(t)), whose equihb- 
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rium average, ao is given by 



CO = HP, Q)) = j^^Qe-/3^(P,Q) (2.100) 

with the unperturbed Hamihonian 7f(P,Q). Fluctuations around this value 
are denoted by 6a{t) = a{t)—ao. The average regression at time ti of a fluctua- 
tion Sa{to), at time to, is given by the auto-correlation function {Sa{to)Sa{ti)) . 
The self-correlation function depends only on the difference ti — to, since we 
are considering a time-translation invariant (equilibrium) state, therefore in 
the following we take to — and ti — t. 

The irreversible processes considered by Onsager, on the other hand, consist 
of the average evolution of the observable a{t), with t > 0, when a small 
perturbation ATi is applied to the Hamiltonian from time — oo up to time 0, 
and then is switched off. This corresponds to a perturbation of the Hamilto- 
nian A7i = —J^a(P,Q,), so that the conjugated field of the perturbation is 
a{P, Q) itself. The average evolution for times t > (the so-called "after-effect 
function") is given by 

/ciPrfQe-^^(P^Q)+^^(^^Q)a(P,Q) 

Furthermore, the perturbation J-'{t) = FQ{—t) is such that a{0) — ao ~ 5a{0). 
The regression hypothesis can therefore be formulated in the following way: 

a{t) -ao ^ {Sa{t)Sa{0)) ^ (a(t)a(O)) - 
a{0)-ao ((MO))') H)-al ' 



By definition, the irreversible evolution in the l.h.s. is governed by macroscopic 
linear \ecws, as discussed in Onsager's two 1931 papers, so that the fiuctuation- 
dissipation theorem (2.16) can be used to compute a{t). For this purpose, 
it is convenient to consider Ti + ATi as the unperturbed Hamiltonian, with 
ensemble averages given by (...)ah, and —AH as the perturbation switched 
on at time 0. From (2.16) one gets: 

a{t) = (a) AH + r dt'{a{0)a{t - t'))An = 
Jo 

{a) AH + PF[{a{t)a{0))AH - H)ah]- (2-103) 

At t — one has (a) ah = + Sa{0). Asymptotically, for t +oo, one 
has a{t) ao, and {a{t)a{0)) ah ~^ ((<^)ah)^) which, substituting in (2.103), 
gives I3FH)ah = l3F{{a)AHf + 5a{Q). With these relations, Eq. (2.103) 
becomes 

ait) =ao + l3F[{a{t)a{Q))AH - {Hah?]- (2.104) 
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It is now plain that, to be consistent with the hnear approximation, all the 
effects of the perturbation A7i can be neglected in the functions appearing in 
the r.h.s, which are of second order in a. This means that all the subscripts 
in the perturbed averages {■■■)ah can be dropped and formula (2.104), i.e. the 
regression hypothesis, turns out to be a particular case of the Fluctuation- 
Dissipation theorem. 



2.4-3 The Onsager reciprocal relations 



In [24,25] , Onsager derived a relation among off-diagonal elements of the evo- 
lution matrix for linear irreversible processes. It was, in fact, the central result 
of that work. Again, it is possible, a posteriori, to offer a simpler derivation 
of that relation, starting from the Green-Kubo formulas. As we have seen, 
a direct consequence of FDR is the possibility to write the transport coeffi- 
cients as time-integrals of suitable correlation functions. In general, if one has 
N conserved quantities, ai{x,t), i — (1, ..N), and small spatial and temporal 
variations of the fields, a linear system of evolution equations can be written 
as 

' =-V-J,(x,t) (2.105a) 
Ji{x,t) ^ LijXj, (2.105b) 



where the fluxes J^, the transport coefficients Lij and the thermodynamic 
forces Xj have been introduced. The latter are the forces conjugated to the 
fluxes in the dissipation function (entropy production) of non-equilibrium ther- 
modynamics [26]. A thermodynamic force Xj is in general a gradient of the 
same quantity Q;j(x, t): this is the application of linear response theory to inter- 
nal forces, in fact the fluxes are responses to internal gradients. For instance, 
the heat flux along the x direction is expressed as g = —ndxT with k, the 
thermal conductivity. Note that for each flux-force pair (i, j), the coefficient 
Lij is indeed a matrix of indexes {k, I) for all possible pairs of the Cartesian 
components, i.e. Lij = (Lfj) with k,l — x,y,z. We recall the Green-Kubo 
relations for these coefficients: 

Lfj^PVj^ ds{J^{t)j\{Q)). (2.106) 

Onsager's reciprocal relations between L^j and L^^ appears as a consequence 
of microscopic time reversibility. The equations of motion for the evolution of 
a phase space point (describing a system of particles) are invariant for the 
time reversal operation /, which transforms Q — Q, P — > — P and t —t. 
This invariance implies the invariance of the phase space probability measure. 
Denoting by -S"* the time evolution operator, which satisfies IS^ — S~^I, the 
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following chain of identities holds for a generic time correlation function: 

jj) = {i{[s'j^]f^) = ([^-*/Jf]/Jj) 

= {[SH^IJ^) = I,I,{[S'Jp,'), (2.107) 

where the invariance to a translation of time has also been used. In the last 
passage, we have exploited the fact that the fluxes have the opposite parity 
of their conjugated density under time reversal, so that /Jf = where 
li = ±1, for example heat and mass fluxes are odd, while the momentum flux 
is even. From the above identities, the reciprocal relations follow: 

Lg = m,L% (2.108) 



3 Fluctuation dissipation in chaotic systems and statistical physics 

The Fluctuation- Response theory was originally developed in the context 
of equilibrium statistical mechanics of Hamiltonian systems[27,28]. In this 
Section we will show that a generalized FDR holds under rather general 
hypotheses[29,30,31,32]: hence also for non-Hamiltonian systems. For instance, 
it holds for a vast class of systems with chaotic dynamics, something that is 
particularly relevant in hydrodynamics [33, 34]. 

Usually the Fluctuation-Response problem has been studied for infinitesimal 
perturbations; in many problems of statistical mechanics this is not a serious 
hmitation. However, it is possible to see that a FD relation holds also for 
finite perturbations. This is important in different contexts, e.g. in geophysical 
or climate investigations, where the study of small perturbations is rather 
academic, while the relaxation of large fluctuations due to fast changes of the 
parameters is an issue of practical relevance [35]. In the following we derive a 
FDR which is valid independently of the number of degrees of freedom. 



3.1 Chaos and the FDR: van Kampen's objection 

Van Kampen argued that the usual derivation of the FDR, based on a first- 
order truncation of the time-dependent perturbation theory for the evolution 
of probability density, is not fully justified [36]. In a nutshell, using the dy- 
namical systems terminology, van Kampen's argument can be summarized as 
follows. Given a perturbation 5x(0), on the state of the system x(0) at time 
0, one can write a Taylor expansion for the difference between the perturbed 
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and the unperturbed trajectories at time t, S:x.{t), whose components are: 



= E ^^^.(0) + 0{\5^m') . (3.1) 

After averaging over the initial conditions, one obtains the mean response 
function: 



Ri,j{t) - 




In a Hamiltonian system one has p(x) oc exp^—l3H{x.)j, so that, integrating 
by parts, we obtain 

(,3) 

which is nothing but the usual FDR [27,28]. 

In the presence of chaos the terms dxi{t)/dxj{0) grow exponentially as e^*, 
where A is the Lyapunov exponent, therefore it is not possible to use the 
linear expansion (3.1) for a time larger than (1/A) ln(L/|5x(0)|), where L is 
the typical fluctuation size of the variable x. Such an argument suggests that 
the linear response theory is valid only for extremely small and unphysical 
perturbations or for short times. Indeed, according to van Kampen's argument, 
the FDR holds up to Is if a perturbing electric field smaller than 10~'^^V/m is 
applied to the electrons of a conductor, in clear disagreement with experience. 

The possible repercussions of van Kampen's arguments are summarized by the 
following two sentences [36] : The basic linearity assumption of linear theory is 
shown to be completely unrealistic and incompatible with basic ideas of statisti- 
cal mechanics of irreversible processes; and Linear response theory does provide 
expressions for the phenomenological coefficients, but I assert that it arrives 
at these expressions by a mathematical exercise, rather than by describing the 
actual mechanism which is responsible for the response. These observations 
stimulated further research which resulted in a deeper understanding of the 
physical mechanisms underlying the validity of the FDR and of its range of 
applicability. 

As a matter of fact, the success of the linear theory for the computation of 
the transport coefficients (e.g. electric conductivity), in terms of correlation 
functions of the unperturbed systems, is transparent, and its validity has been, 
directly and indirectly, tested in a huge variety of cases. To reconcile van Kam- 
pen's argument with the well established linear response theory, note that van 
Kampen considered single trajectories, while the FDR deals with observables 
quantities, which are averages over ensembles of trajectories, and have a much 
more regular behavior than the single trajectories. Indeed, the reason of the 
seemingly inexplicable effectiveness of the Linear-Response theory lies in the 
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"constructive role of chaos" because, as Kubo observed, 'instability [of the 
trajectories] instead favors the stability of distribution functions, working as 
the cause of the mixing" [28]. 



3.2 Generalized FDR for non Hamiltonian systems 

In the following we will give a derivation, under rather general hypotheses, of 
a general FDR, which avoids van Kampen's critique. Consider a dynamical 
system x(0) x(t) = S'*x(0) with states x belonging to a A^-dimensional 
vector space. For the sake of generality, we consider the possibility that the 
time evolution be not completely deterministic {e.g. it could be described 
by stochastic differential equations). We assume that the system is mixing 
and that the invariant probability distribution p(x) enjoys some regularity 
property (see later), while no assumption is made on N . 

Our aim is to express the average response of a generic observable A to a 
perturbation, in terms of suitable correlation functions, computed accord- 
ing to the invariant measure of the unperturbed system. The first step is 
to study the behavior of a single component of x, say a:,, when the system, de- 
scribed by p(x), is subjected to an initial (non-random) perturbation x(0) 



x(0) -|- Axq lJ. This instantaneous kick modifies the density of the system into 
p'(x), which is related to the invariant distribution by p'(x) = p(x — Axq). 
We introduce the probability of transition from xq at time to x at time t, 
lV(xo, — *• X, t). For a deterministic system, with evolution law x(t) = 5'*x(0), 
the probability of transition reduces to M^(xo, — x, t) = 5(x — S^xq), where 
5{-) is the Dirac delta function. Then we can write an expression for the mean 
value of the variable Xj, computed with the density of the perturbed system: 



The mean value of Xi during the unperturbed evolution can be written in a 
similar way: 



Therefore, defining 5xi = (xi)' — (xj), we have: 



The study of an "impulsive" perturbation is not a severe limitation, for instance 
in the linear regime the (differential) linear response describes the effect of a generic 
perturbation. 




(3.4) 




(3.5) 



30 



5xi {t) 



p(xo - Axo) - p(xo) , . , +w ^ 

Xi{t) F(xo, Axo) 



(3.6) 



where 



F(xo, Axo) = 



p(xo - Axq) - p(xo) 
p(xo) 



(3.7) 



Note that the system is assumed to be mixing, so that the decay to zero of 
the time-correlation functions prevents any departure from equilibrium. 

For an infinitesimal perturbation 5x(0) = {6xi{0) ■ ■ ■ 6x^(0)), the function in 
(3.7) can be expanded to first order, if p(x) is non- vanishing and differentiable, 
and one obtains: 



-? — / X sr^/ , ^ 51np(x) 



)Sx,{0) 



t=o/ 
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which defines the linear response 



91np(x) 



dx-i 



(3.9) 



t=o/ 



of the variable Xi with respect to a perturbation of xj. One can easily repeat 
the computation for a generic observable ^(x), obtaining: 



SA{t) = -Y:lA{^{t)) 



din p(x) 
dxi 



)dx,{0) . 



(3.10) 



t=oi 



In the above derivation of the FDR, we did not use any approximation on the 
evolution of 5x(t). Starting with the exact expression (3.6) for the response, 
only a hnearization of the initial perturbed density is needed, and this implies 
nothing but the smallness of the initial perturbation. From the evolution of the 
trajectories difference, one can indeed define the leading Lyapunov exponent 
A, by considering only the positive quantities |5x(i)|, so that at small |5x(0)| 
and large enough t one can write 

^ln|5x(i)|^~ln|(5x(0)| + Ai . (3.11) 

Differently, in the derivation of the FDR, one deals with averages of quantities 
with sign, such as 5x(i). This apparently marginal difference is very important 
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and underlies the possibility of deriving the FDR without incurring in van 
Kampen's objection. 

At this point one could object that in chaotic deterministic dissipative systems 
the above machinery cannot be applied, because the invariant measure is not 
smooth. In chaotic dissipative systems the invariant measure is singular, 
however the previous derivation of the FDR is still valid if one considers per- 
turbations along the expanding directions. In addition, one is often interested 
in some specific variables, so that a projection is performed, making irrelevant 
the singular character of the invariant measure. For a mathematically oriented 
presentation of these ideas, related to a class of particularly well behaved dy- 
namical systems, see [38]. In these general response function has two 
contributions, corresponding respectively to the expanding (unstable) and the 
contracting (stable) directions of the dynamics. The first contribution can be 
associated to some correlation function of the dynamics on the attractor (i.e. 
the unperturbed system). This is not true for the second contribution which 
is very difficult to extract numerically [39]. Nevertheless, a small amount of 
noise, that is always present in a physical system, smoothens the p(x) and 
the FDR can be derived. We recall that this "beneficial" noise has the impor- 
tant role of selecting the natural measure, and, in the numerical experiments, 
it is provided by the round-off errors of the computer. Then, although the 
introduction of noise in a deterministic framework may look unjustified, the 
assumption on the smoothness of the invariant measure along the unstable 
manifold still allows us to avoid subtle technical difficulties, as confirmed by 
Ruelle's work [38]. 

We further observe that these dynamical mechanisms, which work equally well 
in low and high dimensional systems, do not need to constitute the main reason 
for which p can be assumed to be smooth, in systems of physical interest. 
Indeed, in systems of many particles, the projections from high dimensional 
phase spaces to a low dimensional space, is the main reason for dealing with 
smooth distributions. 

In Hamiltonian systems, taking the canonical ensemble as the equilibrium dis- 
tribution, one has Inp = — /5if(Q, P) + constant. If Xi denotes the component 
qk of the position vector Q and Xj the corresponding component pk of the mo- 
mentum P, Hamilton's equations {dqk/dt = dH/dpk) lead to the usual FDR 



In non Hamiltonian systems, where usually the shape of p(x) is not known, 

^ Typically the invariant measure of a chaotic attractor has a multifractal character 
and its Renyi dimensions dq do not depend on q[37]. 



[27,28] 
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relation (3.9) does not give very detailed information. However it shows the ex- 
istence of a connection between the mean response function Rij and a suitable 
correlation function, computed in the non perturbed systems: 

(a;,(t)/,(x(0))) , with /^.(x) = -^, (3.13) 

where, in general, the function fj is unknown. Let us stress that in spite of the 
technical difficulty for the determination of the function fj, which depends on 
the invariant measure, a FDR always holds in mixing systems, if the invariant 
measure can be considered "smooth enough" . We note that the nature of the 
statistical steady state (either equilibrium, or non equilibrium) plays no role 
at all for the validity of the FDR. 

In the case of a multivariate Gaussian distribution. In p(x) = — | J2i,j <^i,jXiXj + 
const, where {aij} is a positive matrix, and the elements of the linear response 
matrix can be written in terms of the usual correlation functions: 

RiAt) = E «i,fe(^iW^fe(0)) ■ (3.14) 

An important nontrivial class of systems with a Gaussian invariant mea- 
sure is the inviscid hydrodynamics, where the Liouville theorem holds, and 
a quadratic invariant exists, see Section 4.1. 

3.3 FDR, chaos and molecular dynamics 

It is not necessary to stress further the relevance of the FDR for the numerical 
investigation of the transport properties: via a molecular dynamics simulation 
one can compute the equilibrium correlation functions and therefore, using 
the Green- Kubo formula, the transport coefficients of liquids models with- 
out the introduction of any simplifying assumption. This approach has been 
successfully used in seminal works [40,41,17]. 

Another method which is more fundamental, from a conceptual point of view, 
but rather simple is to use directly the definitions of transport coefficients: 

one perturbs the system with an external force or imposes driving boundary 
conditions (e.g. a shear) [42,43,44,45] and observes the relaxation process. 
For such a problem, van Kampen's objection is relevant, to some extent. For 
example in numerical simulations, i?i,i(t) is obtained by perturbing the variable 
Xi at time t = tg with a small perturbation of amplitude 5xi{0) and then 
evaluating the separation 6xi{t\to) between the two trajectories x(t) and x'(t) 
which are integrated up to a prescribed time ti = to + At. At time t = ti 
the variable Xi of the reference trajectory is again perturbed with the same 
Sxi{0), and a new sample Sx{t\ti) is computed and so forth. The procedure is 
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repeated M 1 times and the mean response is then evaluated: 

^-(-) = ^E^#47^- (3-15) 

In the presence of chaos, the two trajectories x(t) and x'(t) typically separate 
exponentially in time, therefore the mean response is the result of a delicate 
balance of terms which grow in time in different directions. A naive estimate 
of the error in the computation of -Ri,j(r) suggests an increase in time as 



'M 

where L{2) is the generalized Lyapunov exponent of order 2: 



(3.16) 




(3.17) 



In the above equation 5x(r) is assumed infinitesimal, i.e. evolving according 
the linearized dynamics (in mathematical terms, 5x(r) is a tangent vector of 
the system) [46], and a lower bound for L{2) is given by 2A. Thus very large 
M seems to be necessary, in order to properly estimate this balance and to 
compute Ri^iij) for large r. 

On the other hand, the numerical results obtained with molecular dynamics 
simulations show rather clearly that the presence of chaos does not introduce 
severe limitations in the range of validity of the FDR, in agreement with the 
intuition of Kubo and the derivation of the FDR in the previous section. For 
instance in [42,43], for an ion in liquid argon, a perturbing force of order 
IQ^eV/cm has been used, and a rather good agreement has been obtained 
between the results produced perturbing the system and those deduced from 
the Green-Kubo formula. These results are not restricted to systems with a 
large number of degrees of freedom [47,32]. As a final technical remark we 
note that the error estimate given by (3.16) is rather conservative and the 
uncertainty is actually smaller (at least for r not too large). In [47] one can see 
that for T <T (where T is order of the correlation time) eM{T) first decreases 
and later increases exponentially, but with a rate different from L{2). Indeed 
it is not completely correct in this context to use at finite time the Lyapunov 
exponents (or analogous quantities), which are well defined only at very large 
times. 



^ The same subtle problem appears in the connection between the Kolmogorov- 
Sinai entropy, hxs (which is linked to the Lyapunov exponents via the Pesin 
formula[48]), and the variation rate of the coarse grained Gibbs entropy, re- Detailed 
numerical computations show that typically the (often accepted) identification of 
the two quantities does not hold. The basic reason of this fact is in the asymptotic 
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3-4 Linear response theory, foundations of statistical mechanics and anoma- 
lous diffusion 

This section is devoted to a brief discussion of interesting, and still partly open 
issues involving the relation among linear response theory, the foundations of 
statistical mechanics and systems with anomalous diffusion. 

3.4- i Linear response theory and the foundations of statistical mechanics 

In his celebrated book Mathematical Foundations of Statistical Mechanics, 
Khinchin obtained important results concerning the ergodic and mixing prob- 
lem in statistical mechanics, without recourse to the notion of metrical transi- 
tivity, required by the Birkhoff theorem [50]. The general idea of this approach, 
which will be considered also in Chapter 5, is that the systems of interest in 
statistical mechanics have a very large number of degrees of freedom and the 
important observables are not generic functions. 

In a system with many degrees of freedom and weak interactions among the 
particles 0, consider an observable A which contains the coordinates of only 
one (or a few) particles. Khinchin has shown that the ergodic hypothesis for 
a quantity A, i.e. the vahdity of 

1 r°° 

hm-/ A{t)dt={A), (3.18) 

T->oo 1 Jo 

holds if the auto-correlation of A satisfies the relation 

lim{A(t)A(0)) = (Ay . (3.19) 

t — ^oo 

This result can be reversed, i.e. the auto-correlation CA(t) = (^4(^)74(0)) sat- 
isfies (3.19) if Eq. (3.18) holds uniformly [520. 

(with respect to time) nature of hxs, while re is a quantity related to the short 
time behavior of a given system [49]. 

^ Khinchin considers a separable Hamiltonian system i.e.: 

N 

H = ^F„(q„,p„) . 

n=l 

It is reasonable to think that the result holds also in systems of particles interacting 
through a short range potential, as those studied in [51] for equilibrium statistical 
mechanics. 

^ Note that this result concerns the ergodic hypothesis for only the given observable 
A, which is much weaker than ergodicity in its strict technical meaning, indeed it 
holds only for specific observables, and in systems with many degrees of freedom. 
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On the other hand, we know that correlation functions are closely related to 
the response function, so it is quite natural to investigate the connection be- 
tween ergodicity and linear response theory. In a series of papers [53,54,55,56,57] 
this problem has been discussed in detail. The main result is the possibihty 
to connect ergodic or non ergodic behaviour to the response of a system to an 
external perturbation. One finds that, in a generic system, irreversibility, i.e. 
the validity of (3.19), is a necessary but not sufficient condition for ergodicity. 

Let us indicate, in a symbolic way, the variables which determine the macro- 
scopic state and the control parameters with {A} and {P}, respectively. If we 
perturb the system changing {P} at time t — 0, i.e. {P} {P} + {5P}Q{t) 
one has ^ 

Mft) = SP [ R(t')dt' (3.20) 

where {R} indicates the (differential) response function. For the sake of sim- 
plicity, we assume (^4) — 0. If ergodicity holds for the variable A, one has [53,54]: 

lim I; r f RA{t - t')dtdt' = XA (3.21) 

T->oo 1 Jo Jo 

where xa is the static susceptibility. The advantage of (3.21) over the usual 
condition for ergodicity, Eq. (3.18), is that both sides of (3.21) may be eval- 
uated, for specific models, knowing the unperturbed measure (or equivalently 
the Hamiltonian) . In the linear response theory, for Hamiltonian systems, one 
has 

RA{t) = -jCA{t) = -l{A{t)A{0)) . (3.22) 

Denoting with Ra{z) and Ca{z) the Laplace transform of RA{t) and CA{t), 
respectively, from (3.21-3.22), and using the condition (valid for differentiable 
variables) dCA{t)/dt = for t = 0, the hmit T ^ oo produces 

R^{Q) + Ca{T)-^^^Xa, (3.23) 

or in different form: 

Ra{^) + zCa{z%=o^Xa . (3.24) 
In general one does not know if (3.21), or its equivalent (3.24), holds. It is 
possible to show that the two equations hold and coincide if CA{t) approaches 
zero for large t in a fast way, so that 

roo 

/ CAit)dt < oo . (3.25) 
Jo 

In other words, the condition that CA{t) ^ for t ^ oo is only necessary for 
ergodicity, while (3.25) is sufficient. Note that (3.25) is implied by the Green- 
Kubo formulae, when the {%} are finite quantities. The Khinchin theorem, 
on the other side, requires weak interactions among the components of the 
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system: this is no more guaranteed, in the general case, when CA{t) can have 
a slow decay. 

In [53,54,55] one can find a detailed discussion on different systems (including 
monoatomic chains, oscillator models, chains with impurity, etc.) where the 
powerful recurrence relations method can be successfully applied and it is 
possible to determine whether the condition (3.25) is valid or not. Consider, 
for instance, the case of a nearest-neighbor coupled harmonic oscillator chain 
of 2A'" + 1 atoms, with periodic boundary conditions, containing a tagged 
particle of mass M, while the remaining have mass m. In the — > oo limit, it 
is possible to see that the validity of (3.25) depends on the value of A = m/M. 
If A is finite, the momentum of the tagged particle is an ergodic observable. 

3.4-2 The fluctuation- dissipation relation in the case of anomalous diffusion 

In recent years, many authors have shown that one can have anomalous dif- 
fusion in certain systems [58,59], i.e. one can have 

{x'^{t)) ~ with V ^ 1/2. (3.26) 

Formally this corresponds to£' = ooifi/>l/2 (superdiffusion) and = if 
V <l/2 (subdiffusion). 

Here we shall not discuss the different mechanisms at the origin of anomalous 
diffusion [59] . Our aim is to provide a short discussion of the following problem, 
which comes out in a rather natural way in presence of anomalous diffusion. 
We know, from Chapter 2, that, if in an unperturbed system {x{t)) — 0, in the 
cases with standard diffusion, i.e. with a finite positive diffusion coefficient, 
the response to a small external force is a linear drift 

xify^t , (3.27) 

where the over-bar indicates the average over the perturbed system. One may 
ask how this scenario changes in presence of anomalous diffusion. 

As a consequence of the simple identity 

{x''{t)) = f fc,{ti - t2)dtidt2 , C,{ti - t2) = {v{ti)v{t2)) , (3.28) 

JO Jo 

and the fiuctuation dissipation relation, one has the formal relation 

4^ =K t CJt')dt' , (3.29) 
dt Jo 

where X is a constant depending on the physical details, whose value is not 
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relevant for our purpose. In the superdiffusive case, one has 

(:7^(t) ~r" with a < 1, (3.30) 

and 1/ — 1 — a/2. 

A straightforward consequence of (3.29) seems to be 

^ ~ . (3.31) 

On the other hand it is not difficult to realize that such a formal argument is 
not reliable. Let us consider again the previous discussion, i.e. take a system 
whose state is {A} and the control parameters are {P}. Consider a special 
value {P*} of {P} such that (3.25) does not hold. Now perturb the system 
changing {P} at time t = 0, so that {P*} {P*} + {dP}Q{t). In our case 
R^(t) = C^{t), taking i ^ oo in (3.20), we have 5A{oo) = oo, if i/ > 1/2. The 
validity of such a result is highly questionable: for instance it is easy to obtain 
a finite result: 

SA(^ = {A)p*+sp - {A)p* . (3.32) 

Let us discuss separately the subdiffusive case {u < 1/2) and the superdiffu- 
sive case {u > 1/2). 



3.4.2.1 The subdiffusive case Some authors show that in the subdif- 
fusive case, the result (3.31) holds [60]. This has been explicitly proved in 
systems described by a fractional- Fokker- Planck equation. In the case of an 
overdamped particle, see Sect. 2.3.4, the usual Fokker-Planck equation is 



d 



-Pix,t) ^ jCFpP(x,t) = — 



d fV'(x) 



with Ki — kBT/mrji. For V — one has 

(x^(i)) ~ 2Kit 

while for V — —Fx, 



x{t) 



mrji 



-t , 



(3.34) 



(3.35) 



which is nothing but the Einstein relation for such a system. The fractional- 
Fokker- Planck equation is given by 



d_ 
di 



P{x, t) = V!^ 



1-7 



CFpP{x,t) 



(3.36) 
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where now Cpp is defined as in (3.33) with the changes rji — >■ t]^ and Ki 
K^, and T>}f^ is the so-called Riemann-Liouville fractional operator defined 
through: 



V. 



1-7 



r-^%^rft'withO<7<l, 



(3.37) 



being r(7) the Euler gamma function. For V — one has a generalization of 
(3.34): 



(At)) 



and for V 



-Fx, 



x{t) ~ 



~ 2 

r(i + 7) 

F r 



mrj^ r(l + 7) 

in other words, if we assume the relation — kBT/mr]^, one has: 

lF{x\t)) 



(3.38) 
(3.39) 

(3.40) 



which generalizes the Einstein relation for the subdiffusive case. The investi- 
gation of charge carrier transport in semiconductors [61] showed that, up to a 
prefactor, which could not be determined exactly, eq. (3.40) is indeed valid. 



3.4.2.2 The superdifFusive case This situation is much more dehcate, 
and, as far as we know, the problem is still open. The difficulties are due to 
the fact that the mechanism for the anomalous diffusion is rather subtle and 
can be obtained only in systems with rather peculiar dynamics. For instance 
in deterministic chaotic systems with a fine tuning of the parameters [58,62]. 
Typically the following scenario holds: if for a certain value Pq — P* of the 
control parameters one has C^{t) ~ t'"' with a <1 and therefore v > 1/2, a 
small perturbation Pq ^ Pp — P* + SP restores the standard diffusion with 
1/ = 1/2. More complex is the case of non-chaotic systems, which also show 
anomalous diffusion [63], but it is not completely clear which perturbations 
restore normal diffusion. 

At first, the difference between P* and P* + 6P can appear a paradox, on 
the other hand a precise analysis of the problem shows that the anomalous 
behaviour for P = Pq = P* induces a sort of "ghost" for P = Pp = P* + 6P, 
which is reminiscent of the unperturbed anomalous behavior. For P — Pp 
the correlation function Cy{t) is integrable, however for t < tc{SP) (where 
tc{SP) — s> 00 as SP — > 0) one has Cy{t) ~ therefore the difference between 
the anomalous case (for Pq) and the standard diffusion (for Pp) appears only 
at very large time, leading to a large diffusion coefficient (diverging for 6P — > 
0) [64]. 



39 



With the above scenario one can try to give a solution to the problem. Let 
us denote by C^°^(t) and C^^\t) the correlation function for Pq = P* and 
Pp — P* + dP respectively. In the presence of anomalous behavior (i.e. when 
(3.25) is not valid) it is not possible to exchange the limits 5P — > and i — > oo. 
Since the relaxation time of the perturbed system is tc, Eq. (3.29) is valid only 
for t < tc, while for t > tc, Eq. (3.29) must be replaced by: 

= K C(°) {t')dt' + K f C^^ {t')dt' . (3.41) 
dt Jo Jtc 

As a consequence Eq. (3.31) holds in the range t < tc, while for larger times 
one has the standard result (3.27), with a different prefactor depending on tc- 
One can say that also in anomalous diffusion, a "ghost" for P* remains up to 
large but finite times tc- 

A detailed discussion of this problem for a dynamical model has been given 
in [65]. Both possibilities, that 5P — > before t ^ oo, and that t ^ oo before 
5P — > 0, have been considered. In the first case, one obtains x{t) ~ t^'', for 
the response at large times; on the other hand, for any finite value of SP, 
dx{t)/dt saturates to a finite value, that depends on the perturbation. The 
general scenario suggested in Eq. (3.41) is therefore verified. 



4 Some applications 

The FDR has been extensively used in equilibrium statistical mechanics. Ap- 
plications in near-equilibrium contexts are discussed in any advanced book 
dealing with transport phenomena. In this section we want to discuss how 
to use the FDR in less standard cases, namely non-equilibrium and non- 
Hamiltonian systems. 

4-1 Fluid dynamics 

The Fluctuation-Response theory was originally developed within the frame- 
work of equilibrium statistical mechanics of Hamiltonian systems, giving rise 
to some confusion and misleading ideas about its validity. For instance, some 
authors claimed that in fully developed turbulence (which is a non Hamilto- 
nian and non equilibrium system) there is no relation between spontaneous 
fluctuations and relaxation to the statistical steady state [66]. 

The confusion is due, at least in part, to terminology; for instance, at times 
the term FDR is used just for Eq. (3.14) which is valid in the Gaussian case. 
Nevertheless the FDR plays a role in analytical approaches to the statistical 
description of hydrodynamics, where Green functions are naturally involved. 
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both in perturbative theories and in closure schemes [67,68,69], as well as in 
other fields, like in geophysical or climate studies [70, 71, 72]. 



4.1.1 Interlude on Statistical Mechanics of Fluids 

The Navier-Stokes equations for the evolution of the velocity field v(x, t) of 
an incompressible fluid are: 

+ (v(x, t) ■ V)v(x, t) = -^Vp(x, t) + ^Av(x, t) + F(x, t) , (4.1) 

V-v(x,t) = 0, (4.2) 
where p(x, t) is the pressure in the point x at time t; p and v are the density 
and the kinematic viscosity of the fluid respectively. 

For a perfect fluid (i.e. z/ = 0) and in the absence of external forces (F = 0), the 
evolution of the velocity field is given by the Euler equations, which conserve 
the kinetic energy. Such a case may be easily treated within an equilibrium 
statistical mechanics framework, simply following the approach used for the 
Hamiltonian statistical mechanics [73]. Consider a fluid in a cube of edge L 
and assume periodic boundary conditions, so that the velocity fleld can be 
expressed in terms of Fourier series as follows: 

v(x,t) = -^X:u(k,^)e^'^'' (4.3) 

with k 27rn/L and n — (ni, ...,71^), Uj being integers and d the spatial di- 
mension. By introducing (4.3) in the Euler equations, and imposing an ultra- 
violet cutoff, u(k) = for A; > K^^x, one obtains a set of ordinary differential 
equations of the form: 

dY ^ 

-^ = Y.^a,.Y,Y. (4.4) 

'^^ b,c 

where ~ -^max is the number of degrees of freedom, and the variables 
{Ya} are a subset of the full Fourier spectrum {u(k)}. The incompressibility 
condition yields k • u(k) = 0, and the fact that u(k) is real yields u(k) = 
u*(-k). 

As a consequence of the energy conservation one has 

^ ^ = £^ = constant . (4.5) 

In addition, the coefficients Aabc have the properties Aahc = Aacb , Aabc + 
■^bca + -^cab — 0, and incompressibility makes the Liouville theorem hold: 

(9 dY 
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so that the necessary ingredients for an equihbrium statistical mechanical 
approach are all present. Assuming, in analogy with the treatment of Hamil- 
tonian systems, a microcanonical distribution on the constant energy surface 
I J2a — fo'^ large N it is easy to obtain the invariant probability density 
of 



(4.7) 



and the energy equipartition < >= 2^ = (3 ^. 



In two dimensions another quantity is conserved: the enstrophy ^ / |V x 
u(x, t)prfx which, in terms of the {Ya}, can be written as 

I Y: klY^ = ^ = const. (4.8) 

Assuming a microcanonical distribution on the surface where both the energy 
and the enstrophy are constant, and taking the large N limit, one obtains 

PU{ya}) ^exp-\ U E Ya + /52 E klrf) (4.9) 

where the Lagrange multipliers /?i and are determined by E and f2. 

Other systems, like magnetohydrodynamics and geostrophic fluids, have quadratic 
invariants and obey the Liouville theorem in the inviscid limit. In such sit- 
uations it is straightforward to generalize the previous results as 

PinA{Ya}) CX eXV \-\Y.^a,hyay\ (4.10) 

where {aa^h} is a positive matrix dependent on the specific form of the invari- 
ants and on the values of the Lagrange multipliers. 

A statistical steady state requires a forcing in the case of a viscous fluid, which 
results in: 

' d \ ^ 

- + vkiy, = E Aa,,Y,Y, + , (4.11) 

instead of eq. (4.4). It is well known[69] that in 3D the limit z/ — >■ is singular 
and cannot be interchanged with the limit Kmax oo, therefore the statistical 



^ Numerical results in 2D and 3D inviscid hydrodynamics, as well as in other in- 
viscid cases (e. g. magnetohydrodynamics) show that the systems described by the 
inviscid truncated Eq. (4.4) with quadratic invariant, are ergodic and mixing [74, 75]: 
arbitrary initial distributions of {Y^} evolve towards the multivariate Gaussian 
(4.10). 



42 



mechanics of an inviscid fluid has a rather hmited relevance for the Navier- 
Stokes equations at very high Reynolds numbers. In the z/ — > limit in 
presence of forcing at large scale (small k) one has an intermediate range, 
called the inertial range, which has neither pumping nor dissipation and shows 
a strong departure from equipartition[69,73]. Instead of < >= const, one 
has < >~ k''' where 7 ~ 11/3, the value 7 = 11/3 corresponding to the 
Kolmogorov spectrunf^ E(k) ~ k"^/^. 



4- 1.2 A general remark on the decay of correlation functions 

Using general arguments, one could naively conclude that all typical corre- 
lation functions, at large time delay, have to relax to zero with the same 
characteristic time related to spectral properties of the operator C, governing 
the time evolution of the probability distribution P{{Y},t): 

|p({F},t) = £P({r},t). (4.12) 

The argument goes as follows: let the time evolution of the system be described 
by ordinary differential equations dYa/dt = Xa{{Y}) so that CP{{Y},t) = 

- Ea afe {Xai{Y})Pi{Y}, t)) , for the system (4.11), where X, = Ea,fe A^^^Y^Y,- 

yk'^a + fa- Let us introduce the eigenvalues {ofc} and the eigenfunctions 
{V'fe} of C: 

Ci)k = akil)k- (4.13) 

Of course ipo = Pmv and ao = 0; moreover the mixing condition requires 
that Reak < for k = 1,2,.... Furthermore assuming that the coefficients 
{91^92, ■■■} and {hi, h2, ...} exist, such that the expansion of the functions 
g{{Y}) and h{{Y}) are unique: 

9{{Y}) = E 9kM{Y}) , h{{Y}) = Y: hkM{Y}) , (4.14) 

fc=0 A;=0 

^ In 2D the use of conservative statistical mechanics has been proposed to justify 
some behaviors of real fluids, e.g. Jupiter's red spot and the formation of coherent 
structures [76,77]. This approach, although interesting, is Hmited to some specific 
two-dimensional situations. 

^ E{k)dk is the contribution to the kinetic energy of the wave numbers in the range 
[k,k + dk]. 

^ In the presence of white noise terms {r]a} in eq. (4.11), i.e. Xa Xa + rja where 
{r]a} are Gaussian processes with < r]a{t) >= and < r]a{t)r]i,{t') >= 2Aab5(t — t'), 
one has to add to C the term[13] 

^, 
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one has 

Cg,f{t) = Y.9kK<i^l>e'^''\ (4.15) 



where C,j(i) =< gi{Yit)})h{{Y{0)}) > - < gi{Y}) >< h{{Y}) >. For 
"generic", i.e. not orthogonal to ipi, so that 5^1 7^ and hi ^ 0, functions g 
and /, the quantity Cgj{t) approaches zero at large time: 

C,.,W~e-'A-,x„ = ^. (4.16) 

Naively this argument seems to imply that in hydrodynamic systems all the 
correlation functions, Ca,a{i) =< ^(^)^(0) >, relax to zero with the same 
characteristic time for all ka, while one expects a whole hierarchy of character- 
istic times distinguishing the behavior of the correlation functions at different 
scales [69]. The paradox is, of course, only apparent since the above argument 
is valid only at very long times, i.e. much longer than the longest characteristic 
time, hence it tells nothing about systems with many different time scales. 



4.1.3 FDR in perfect fluids and in turbulence 

Although the inviscid fluid mechanics is not a Hamiltonian system, Eqs. (3.3) 
and (4.7) (or (4.9) in 2D) make the FDR take the simple form 

(4.17, 

because of the Gaussian statistics. To the best of our knowledge, Kraich- 
nan was the first to realize that the FDR may hold in a non Hamiltonian 
context [33, 34]. As a matter of fact, in the case of turbulence the scenario is 
not too simple for two reasons: 

a) the (unknown) invariant measure is not Gaussian 

b) the degrees of freedom {Ya} are not independent. 

Nevertheless the general result discussed in Section 3 suggests that a relation 
between response and a suitable correlation function must exist. Indeed, also 
in turbulence there are many degrees of freedom, which are likely to yield a 
smooth distribution, when projecting on lower dimensional spaces, as required 
for the FDR. 

The FDR plays an important role in the statistical closure problem, which has 
to be tackled by any non linear theory. In our case the evolution equations for 
Caa{t) =< Ya{t)Ya{0) > have the form 

{j^+ukl)c^^F^{C^'^) (4.18) 

where Fa is a function of the third-order correlations C^^^ i.e. of terms like 
{Ya{t)Yb{0)Yc{0)). In the equations for the C^^\ fourth-order correlations C^^) 
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appear, and so on. An analogous situation occurs in the kinetic theory of gases, 
with the Bogolyubov-Born-Green-Kirkwood-Yvon hierarchy [78]. Experience 
has shown that it is quite efficient to truncate the hierarchy at a certain level, 
making some closure hypothesis. The simplest assumption in our case is the 
quasi-normal approximation, which assumes that the fourth-order cumulants 
vanish, i.e that 

< YaY^Y.Yd >=< YaY, >< Y,Yd > 

+ <YaY,><Y,Y^> + <Y,Yd><Y,Y,> . (4.19) 

Unfortunately the resulting set of equations gives unphysical results, such as 
negative E{k) for some k. Therefore it is necessary to introduce more precise 
hypotheses. One approximation which has been successfully used is the so 
called eddy-damped quasi-normal Markovian approximation, which takes into 
account the physical mechanism of the energy transfer [79]. 

An alternative approach is the direct-interaction-approximation (DIA) devel- 
oped by Kraichnan[67,80] which is one of the few self-consistent analytical 
turbulence theory so far discovered. In the DIA one writes separately equa- 
tions for responses {R} and for correlations {C} 

^ + ^fc^)c,,,(t,t') =^a({C},{i?}) (4.20) 
^^+ukiy,,,{t,t') = g^i{C},{R}) (4.21) 



where Ca,a{t,t') =< Ya{t)Ya{t') >, Ra,a{t,t') = SYa{t) / 6Ya{t') , Ta and Qa are 
(rather complicated) nonlinear integral expressions involving {C} and {-R}. 
The DIA equations give the correct results (including the FDR in the form 
(4.17)) in the inviscid limit. In addition, for the "random coupling model", i.e. 

d 



- + ukiya = j:A',,,Y,Y,, (4.22) 
where A'^f^^ = ±Aabc with the sign varying randomly from triad to triad (a, b, c). 



Kraichnan[67] showed that DIA equations are exact, li^ Although the DIA 
equations (4.20,4.21) are closed, they are very complicated, so simplifications 
are usually introduced, like the so called Simple-Pole Model [82] where basi- 
cally one assumes the FDR in its simplest form: 

CaAt,t')=Ra,a{t,t')Ca,a{t',t') t > t' . (4.23) 



The DIA gives exact results also in other cases, e.g. in the large- limit of the 
spherical model of turbulence [81] where the velocity field in (4.1) is now a vector 
with components, i.e. v G R^, while x G R'^. 
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It has been shown that renormahzation group methods and the so called time- 
ordering approach [83,68] give the same results with an exponential form: 

C„,„(t, t') = Ca,a{t', tOe-e^")!*-*'! t>t', (4.24) 

RaAt, t') = e-(^<')(*-*') t>t', (4.25) 
with uj{k) ~ k~'^^^ in agreement with simple dimensional arguments. 

Note that Eq. (3.13) indicates that assumption (4.23) is equivalent to as- 
sume Gaussian statistics for {¥} without imposing a specific covariance ma- 
trix. Since it is well known, from both numerical and experimental results, 
that for very high Reynolds numbers, the statistics of the velocity fields is 
rather far from Gaussian, e.g. one has long tails in the PdF and intermit- 
tent behavior [69, 73], eq.(4.23), or eqs. (4.24, 4.25), can not be completely 
correct. However on intuitive grounds one expects the times characterizing 
the responses {R} to approximate the characteristic correlation times of {C}. 
Numerical investigations [80] at moderate Reynolds number of the DIA equa- 
tions, show that Ra,a(t,t') is not exactly proportional to Ca,a{t-i't')-i however 
comparing the correlation times Tc{ka) (e.g. the time after which the correla- 
tion function becomes lower than 1/2) and the response time TR{ka) (e.g. the 
time after which the response function becomes lower than 1/2), one has that 
the ratio Tc{ka) / TR{ka) stays constant through the inertial range. 



4- 1-4 Numerical results for simplified models 

Let us now discuss some numerical tests of the FDR in simplified models of 
fluid dynamics. Such systems are far from being realistic, but are nontrivial 
and share the main features of the Navier- Stokes, or the Euler equations. 
Consider the model [84]: 

dYn 

= + Yn-lYn-2 — 2F„_|_il^_i (4-26) 

with n = (1,2, ...,A^) and the periodic condition Fn+iv = Yn- This system, 
originally introduced as a toy model for chaos in fluid mechanics [84], contains 
some of the main features of inviscid hydrodynamics: a) quadratic interactions; 
b) a quadratic invariant, E = ^ S^=i c) the Liouville theorem holds. For 
sufficiently large the distribution of each variable Y^ is Gaussian. In this 
situation, the Gaussian-hke FDR holds for each of the n variables, i.e. self- 
response functions to infinitesimal perturbations are indistinguishable from 
the corresponding self-correlation functions [32] . 

We can slightly modify the system (4.26) in order to have variables with 
different characteristic times; for instance, by rescaling the evolution time of 
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each variable[85] : 



dYn 

— kn ■ {Yn+{Yn+2 + — '^'Yn+lYn-l) , (4.27) 

where the factor A;„ is defined as = a • /3'^, with /3 > 1, for n = 1, 2, N/2, 
with the "mirror" property kn+N/2 — ^Ar/2+i-n- For the system (4.27) a quadratic 
integral of motion exists: 

^ = E (4.28) 

n=l '^■n 

Moreover, if iV ^ 1 the {Yn} variables preserve the Gaussian statistics with 
< YrXm >=< Y^ > Snrn oi. kn- As a consequcncc the simplest FDR, i.e. 
Eq. (4.17), holds for each of the variables. On the other hand, at variance 
with the original system (4.26), each Yn has here its own characteristic time. 
Figure 1 shows the (expected) validity of (4.17), however the shape of C„„(i) 
changes with n. The correlation time of a variable F„ behaves as 

Tcikn) ~ k-'"'' . (4.29) 

The exponent of this scaling law can be easily explained with a dimensional 
argument, by noticing that < Y^ >~ kn, and from (4.27) the characteristic 
time results to be just Tc{kn) ~ a/< Y^ >/{kn < Y^ >) ~ k'^^"^. 




Let us now discuss more interesting cases, i.e. the chaotic dissipative systems 
with non Gaussian statistics, called "shell models" which have been introduced 
to study the turbulent energy cascade and share many statistical properties 
with turbulent three dimensional velocity fields [73,86]. Let us consider a set of 
wave-numbers kn = 2^/co with n = 0, . . . , N, and the shell- velocity (complex) 
variables M„(t) which must be understood as the velocity fluctuation over a 
distance In = k~^. In the following we present numerical results for a particular 
choice, the so-called Sabra model [87,86] : 

knUn+^Un+2 + fe/Cn-l^^n+l^tn-l + (1 + b)kn-2Un-2Un-l + fn 

(4.30) 

where 6 is a free parameter, f is the molecular viscosity and /„ is an external 
forcing acting only at large scales, necessary to maintain a stationary tempo- 
ral evolution. We note that the shell models have the same type of quadratic 
nonlinearities as the Navier-Stokes equations in the Fourier space. In addition 
in the inviscid and unforced limit {i^ = fn = 0) the energy {\ J2n \'^n\'^) is 
conserved and the volumes in phase space are preserved. Because of the above 
properties, the set of coupled ordinary differential equations (4.31) possesses 
the features necessary to mimic the Navier-Stokes non-linear evolution. The 
main, strong, difference with the previous inviscid models (4.26, 4.27) is the 
existence of a mean energy flux from large to small scales, which drives the sys- 
tem towards a strongly non-Gaussian stationary state [73] . The shell models 
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Fig. 1. FDRs for the six fastest variables of the model (4.27), with = 20, 
a = 0.005 and /3 = 1.7, n = 5,6,7,8,9,10. Thin lines represent the normalized 
correlation functions C„^„(t)/C„^„(0). Self-response functions Rn,n are plotted with 
statistically computed error bars. 

here discussed present exactly the same qualitative difficulties as the original 
Navier-Stokes eqs.: strong non-linearity and far from equilibrium statistical 
fluctuations. The most striking quantitative feature of the fully developed tur- 
bulence, i.e. the highly non-Gaussian statistics and the existence of anomalous 
scaling laws for the velocity moments, is reproduced in shell models, in good 
quantitative agreement with the experimental results[73,86]. One has: 



<(P) 



(4.31) 



where C,{p) 7^ ^C{'^)i which implies that the velocity PDF's at different scales 
cannot be rescaled by any change of variables. 

Let us now examine the numerical results concerning the response functions in 
the shell model[85]. Figure 2 shows the normalized diagonal responses, i?„„(t), 
for kn in the inertial range, n G [7,14]. It is evident that the characteristic 
response time Tnikn) decreases as kn increases. 

In Figure 3, one sees a clear difference between the response and the correla- 
tion function: this is an additional indication that the inertial-range statistics 
are very far from Gaussian. Although the Rnn{t) do not coincide with the 
(normalized) C„„(i)/C„„(0), the times Tc{kn) and TR^kn) are not very dif- 
ferent Tc{kn) oc TR{kn), in agreement with the numerical result obtained by 
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Kraichnan with the DIA at moderate Reynolds numbers[80]. In addition, one 
has a scahng behavior Tf{{kn) oc Tc{kn) ~ , where 7 is close to the value 
2/3 of the Kolmogorov scaling. 




12 3 
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Fig. 2. Response functions, Rn,n{t), for shells n = 7, 8, . . . , 13, 14 (from top to 
bottom). Error bars are shown only for the smallest and the largest scales. The 
parameters in eqs. (4.30) are b = 0.4, 1/ = 5.10"^, and N = 25. 
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Fig. 3. Comparison between the averaged Response Function, Rnn{t), (top) and 
the (normalized) self-correlation, Cn,n{t) / Cnni^) (bottom) for the shell n = 10. 
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4-2 Beyond the linear FDR and climate 



In the case of finite perturbations, the FDR (3.6) is typically non-hnear in the 
perturbation Axq, and thus there are no simple relations analogous to (3.8). 
Nevertheless Eq. (3.6) guarantees the existence of a link between equilibrium 
properties of the system and the response to finite perturbations. This fact has 
a straightforward consequence for systems with a single characteristic time, 
e.g. a low dimensional system: a generic correlation function gives information 
about the relaxation time of finite size perturbations, even when the invariant 
measure p is not known [35]. We saw that in systems with many different 
characteristic times, such as the fully developed turbulence, one has a more 
complicated scenario: different correlation functions show different behaviors. 
For a finite perturbation 5x(0) such that ^(x(0) + 5x(0)) - ^(x(0)) = M(0), 
instead of (3.10) one has: 

SA{{j = {A (x(t)) F (x(0), 5x(0))) , (4.32) 

therefore the relaxation properties depend explicitly on the initial perturbation 
(5x(0) and not only on the value of 6A{0). In the following we will discuss the 
relevance of the amplitude of the perturbation, which may play a major role in 
determining the response, because different amplitudes may trigger different 
response mechanisms with different time scales [35,85]. 



4.2.1 Response to finite perturbations 

Consider two cases with a single characteristic time: a low dimensional deter- 
ministic chaotic system, known as the Lorenz model, and a nonlinear Langevin 
equation. We begin with the Lorenz model [88]: 



dx 

^ = —xz + rx — y (4.33) 
dz 

— —xy — bz 
dt ^ 

with standard parameters for chaotic behavior: b = 8/3, cr = 10 and r = 28. 
The correlation function of the variable z, shown in Figure 4, qualitatively 
reproduces the behavior of the response to different sizes of the perturbation 
of the z variable, ranging from infinitesimal ones up to those of the size of the 
attractor. The agreement between the response function and the normalized 
correlation function is just qualitative and it does not depend too much on 
the amplitude of the perturbation, because the invariant distribution is not 
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Gaussian (see inset of Fig. 4) and the general correlation (3.13) should be 
used. 
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Fig. 4. Normalized correlation function of the z variable of Lorenz model (solid line) 
compared with the mean response to different perturbations of the same variable, 
fco = 10~^c7 (dashed line), bzQ = a (dotted line), with a"^ = (z^) — (z)^ = 75.17. In 
the inset the invariant probability p{z) versus z. Being a ID projection, p{z) results 
regular, even if the full 3D distribution is fractal. 

To better illustrate this point, we consider a system whose invariant proba- 
bility distribution is known. In this case, we can quantitatively compare the 
differences between the responses to infinitesimal and finite perturbations. Let 
us consider the stochastic process x{t) described by 



dx 



dU{x) 
dx 



+ V2Dr]{t) 



(4.34) 



where ri{t) is a white noise. The invariant probability distribution is [13]: 

p{x) = 7\Ae-^(^)/^ (4.35) 
where J\f is fixed by normalization, and 



U 
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(4.36) 
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The resulting pdf, shown in the inset of Fig. 5, has a Gaussian core, with 
exponential tails. Figure 5 also shows the response function for an infinites- 
imal and for a finite size perturbation. For both perturbations, the response 
function measured from the perturbed trajectories is exactly predicted by the 
statistics of the unperturbed system according to (3.13), while the Gaussian 
correlation C{t) = {x{t)x{0)) /a'^ is only an approximation of the response. By 
construction, the pdf of this system has larger tails than in the Gaussian case, 
thus large fluctuations have slower decay than small ones. On the contrary in 
the Gaussian case, i.e. U {x) = |a;^ for any x, the response is an exponential 
function and does not depend on the amplitude of the initial perturbation 
Sx{0). 
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Fig. 5. Response of the stochastic differential equation (4.34) with D = 1 and 
U{x) as in (4.36), to different perturbations: large Sxq = 2.Sa (+) and infinitesi- 
mal 6xq = 7.6 X 10~^cr (x). In both cases the mean response is exactly predicted 
by the correlation function < x{t)f{x{0)) >, with f{x) given by (3.6,3.7), dashed 
line for Sxq = 2.3a and dotted line for Sxo = 7.6 x 10~^. The correlation func- 
tion {x{t)x{0))/a^ (solid line) is shown for comparison. In the inset the invariant 
probability distribution p{x)a versus x/a with cr^ = (x^) — (x)^ = 1.15. 

We have already seen how in systems with many characteristic times, different 
correlation functions behave differently and a variety of time scales emerges, 
which correspond to the different decay times of the correlation functions. In 
addition, at variance with systems with a single time scale, the amplitude 
of the perturbation plays a major role in determining the response, because 
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different amplitudes affect features cliaracterized by different time scales. To 
illustrate these ideas, we refer to the shell model (4.30) and consider the total 
energy E{t) = | J2n=i l''^n(^)P which is conserved in the inviscid, unforced limit 
[73] . We study the response to perturbations of E with different amplitude, of 
the following form: 

\S4\0)\ = { ^ - - . (4.37) 

'\un\^) ,i<n<N 

The value oi i = 1,..,A^ determines the largest spatial scale I of the per- 
turbation, £ ~ k^^ . This corresponds to a set of initial perturbations of the 
energy 

1 N 

^E^H^) = l,Y.M. (4.38) 

n=i 

Such a kind of perturbation is motivated by the fact that, in the unper- 
turbed system, the energy is distributed among the shells according to the 
Kolmogorov scaling (|MnP) ~ k'"^^^, and the smaller scales give smaller con- 
tributions to the energy E{t). Thus it is natural to assume that a small per- 
turbation of the energy affects mainly the small scales. 

For each perturbation SE^'^^Q), the average energy response 



^^^^^ - Jmo) ^ ' 

reveals a behavior similar to the correlation function of the largest perturbed 
shell Ui{t), as shown in Fig. 6. An additional measure of the relaxation time 
is provided by the halving times Th of the mean response, when 6E^\Th) — 
^5E^'^\0). The dependence of the halving times on the amplitude of the initial 
perturbation reflects the Kolmogorov scaling for characteristic times. Noting 
that Tc{kn) ~ TR{kn) ^ A;-2/3 ^ ul ^ 6E^'\0) one has: 

Th ~ 5E^\0) . (4.40) 

The above results show that the response of a system with many characteristic 
times to a finite size perturbation may depend on the amplitude of the per- 
turbation. Thanks to the apphcability of the FDR, it is possible to estabhsh 
a link between relaxation times of different perturbations and characteristic 
times of the system. 



4.2.2 FDR and climate 

One of the key issues in climate modeling is the study of the response to per- 
turbations of the external forces, or control parameters. In such a context, the 
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Fig. 6. Mean response RE{t) of the total energy E{t) = ^^|unP of the sheh 
model (4.30) to different amplitude perturbations: (^£'(^^^(0) = 5.5 x 10~^ (+), 
(5£;(^^)(0) = 1.7 X 10-3 (x), 5£;(^6)(0) = 4.5 x lO''^ (*); and the (normalized) 
correlation functions of the corresponding largest perturbed shell: shell n = 12 
(solid line), shell n = 14 (dashed line), shell n = 16 (dotted line). 

importance of the FDR is rather obvious: if it holds there is the possibihty, at 
least in principle, to understand the behavior of the system under perturba- 
tions (e.g. a volcanic eruption, or change of the C O2 concentration) in terms 
of the knowledge obtained from its past time history[70,71]. 

To describe the climate system, let us consider the symbolic evolution equa- 
tion: 

^ = Q(X) + m (4.41) 

where X is the state vector for the system, Q(X) represents complicated 

dynamical processes and f(t) the external influences. The average effect of an 
infinitesimal perturbation 5f (t) can be written in terms of the response matrix 
Ra,j3{t); if 5t{t) = for t < one has: 

Jx:^) =Y.f R^,p{t - t')Sff3{t')dt' . (4.42) 

The goal is to write Ra^fjit) in terms of correlation functions of the unperturbed 
system. 

Under many points of view, the questions concerning the FDR in climate sys- 
tems are rather similar to those posed in fluids dynamics, because one deals 
with non Hamiltonian and non linear systems, whose invariant measures are 
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non-Gaussian. On the other hand, in chmate studies, one hardly faces equa- 
tions obtained from first principles, and typically it is necessary to work with 
rather crude models, or with experimental time series [89]. Moreover, in cli- 
mate problems and in geophysics, the interest in infinitesimal perturbations 
is rather academic, while the interesting problem is the behavior of the relax- 
ation of large fiuctuations, due to sudden changes of the parameters. 

Starting from the seminal works of Leith [70,71], who proposed to employ 
the FDR to study the response of chmatic systems to changes in the external 
forcing, many authors applied this relation to different geophysical problems, 
ranging from simplified models [72], to general circulation models [90,91] and 
to the covariance of satellite radiance spectra [92]. In most of these attempts, 
the FDR has been used in its Gaussian version, eq. (3.14), which has been 
acritically considered a reasonable approximation, without investigating its 
limits of applicability. For a recent application to climate models with fast 
and slow variables see [93] . 

The results previously discussed show that a FDR holds also for non infinites- 
imal perturbations. This generalization of the usual linear response theory has 
an obvious interest for chmate applications. Although the FDR in its simplest 
form (3.14) does not hold, one has, at least, a qualitative agreement between 
responses and correlations. In particular, from features of the unperturbed 
dynamics, one infers the presence of different response times associated with 
different variables. This description is quahtatively satisfactory. But a precise 
quantitative estimate faces difficult technical problems such as: 

a) the FDR involves the detailed form of the invariant probability distribution 
(which is usually unknown) 

b) non infinitesimal perturbations require good statistics to resolve the rare 
events. 



4-3 Granular materials 

Granular systems [94,95,96] constitute an example of non-equilibrium physics, 
pervading our everyday life: sand, sugar, coffee, pills, seeds, powders, etc., are 
all instances of the "granular state of matter". For the behavior of granu- 
lar systems, the environment temperature plays only a marginal role. At the 
same time these systems are made of relatively many particles. This suggests 
that statistical mechanical methods, such as kinetic theory, hydrodynamics, 
thermodynamics and linear response can be adapted to granular materials. 

A starting point of the statistical approach is to identify a distribution that is 
left invariant by the dynamics, as is the case of the microcanonical distribu- 
tion in Hamiltonian systems, and the conditions under which this distribution 



55 



can be reached, starting from a generic initial condition. Unfortunately, sta- 
tistically steady states of granular matter are usually given by the balance 
of non-conservative forces, such as external tapping and inelastic collisions or 
friction with the boundaries, and the corresponding invariant measures are 
not known. It is therefore natural to ask whether it is possible to speak at 
all of a granular temperature. This question has different answers, depend- 
ing on the degree of diluteness of the granular system under examination. 
The most straightforward definition comes from the case of dilute, strongly 
vibrated granular systems, which reach a non-equilibrium stationary state: 
by analogy with molecular gases, a "granular temperature" Tg can be de- 
fined in terms of the average local kinetic energy per particle. This approach 
can a priori be extended to denser, liquid-like, strongly vibrated systems [97]. 
However, if the density is further increased, or the external energy injection 
strongly reduced, the assumption of ergodicity becomes less and less obvious: 
reaching a stationary state may become experimentally or numerically very 
difficult. Dense granular systems exhibit aging [98,99] and memory [100,101]. 
Analogies with other aging systems have also led to the definition of dynamic 
temperatures as quantifying the violation of the Hamiltonian version of the 
fluctuation-dissipation theorem [102]. In this review, we do not touch on non- 
ergodic statistical physics, hence we do not discuss glassy granular systems 
and we focus only on systems that rapidly forget their initial conditions. This 
class includes the so-called "granular gases", i.e. granular systems which are 
fiuidizcd by different means, for instance strongly shaking the container, or 
otherwise letting a low-density fiuid (e.g. air) pass around the grains at high 
velocity. 

In Appendix A the reader can find a brief review of the models used for the 
granular gases. Such models include the following ingredients: a gas of par- 
ticles, a collision rule that dissipates kinetic energy, and a dynamical rule 
governing the dynamics between collisions. This dynamics depends upon the 
external forcing. If the system is driven from the boundaries (shaking the 
container) and gravity can be neglected, for example in microgravity exper- 
iments, the bulk dynamics is made of straight paths plus inelastic collisions. 
If the container is large, the external energy may take a long time to reach 
the interior of the gas: this motivates the study of pure coohng models [103]. 
They are considered as the building blocks of the hydrodynamics of boundary 
driven granular gases [104]. For this reason, several authors have considered 
the application of the theory of linear response to perturbations of these sys- 
tems, as a valid alternative to kinetic theory, for the derivation of transport 
coefficients [105]. Here, the analysis is more difficult because there is no steady 
state, but only a scaling behavior towards a state with all the particles at rest, 
which undermines basic assumptions of kinetic theory, such as the separation 
of scales and the fast equilibration of microscopic modes [106,107]. On the 
other hand, experiments with uniform drivings, i.e. setups where the injection 
of energy reaches all grains, show a very rich phenomenology and are much 
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easier to model: the gas reaches a statistically steady state and the formalism 
introduced in Sec. 3 can be applied. 



4.3.1 Cooling granular gases 

Most of the work devoted to linear response in cooling granular gases, concerns 
the calculation of transport coefficients for small perturbations of the homo- 
geneous cooling state, under different assumptions [108,109,110,105]. A well 
established approach [111,112] considers the Boltzmann equation for a granu- 
lar gas as the starting point, see Appendix A, Eq. (A. 3) with F = 7 = 0, which 
describes the evolution of a single particle velocity distribution /(x, v, t), in a 
gas with particles interaction given by inelastic collisions, obeying the rule of 
Eq. (A.l). The effect of collisions is included in the collision integral, Eq. (A. 4). 

Following the standard kinetic theory procedure, it is possible to derive balance 
equations for the usual fields: 



An + nV ■ u = (4.43) 
DtUi + {mn)-^VjPij = (4.44) 

DtTg + |- {PijVjUi + V • q) + = 0, (4.45) 

where n, u and Tg are the density, velocity and temperature fields respec- 
tively, and Dt = dt + u ■ V . The pressure tensor Pij, the heat flux q and the 
cooling coefficient ( depend upon the particular (time dependent) form of the 
distribution function /(x, v,t). A homogeneous scaling solution /o(x, v,t) = 
nwo"''(t)/o (v/t'o(t)) is supposed to exist: it has no x-dependence (homogene- 
ity) and the time-dependence is all included in the thermal velocity Vo{t) — 



2Tg{t)/m [113]. Such a solution must satisfy an equation for Tg{t), which 
results in the so-called Haff law [114] for the homogeneous granular cooling. 
At large times, in the homogeneous case, the granular temperature decays as 

Tg{t) ^ 

It is possible to express a generic perturbation of the scaling state /o in terms 
of the gradients of the macroscopic fields n(x, t), u(x, t),Tg{-x, t). Substituting 
this form in the Boltzmann equation and retaining only terms of first order 
in these gradients results in expressions for the pressure tensor and the heat 
fiux, which are linear in the field gradients [111]: 

2 

Pij ^p{x, t)Sij - r]{VjUi + ViUj - -5ijV ■ u) (4.46) 
q^-KVTg - AtVn, (4.47) 

where is a new coefficient peculiar to granular gases, which vanishes in 
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the elastic limit, and the following "Green-Kubo" relations hold, giving the 
transport coefficients: 

^m-7^r"'UOUmj^-'^ (4.48) 
^it) = '^fds'{S'(s')-n)o'^ (4.49) 

n a Jo 

The transport coefficients depend upon the time t, which is related to the time 
s through the transformation ds — dtvo{t)/i, with i the mean free path, i.e. 
s is proportional to the total number of collisions occurred since the initial 
time. In the above expressions the transport coefficients are obtained as time 
integrals of correlation functions calculated with the unperturbed distribution 
/o (the average (...) refers to this distribution). These are correlations between 
the currents at time s' 



D*. = V*V* - ^V*^6^j (4.51) 
S*^(v*^ -^^^y*, (4.52) 
and new conjugated quantities at time 0: 



2 \d 



_ 



d 



ln/*-V* [d + V* 



d 



In/o 



(4.53) 
(4.54) 
(4.55) 



The rescaled peculiar velocity V* = (v— u(x, t))/vo{t) and the rescaled cooling 
coefficient (* = C^/vq have been used in the above expressions. In the elastic 
limit r — * 1, the unperturbed state /o becomes the Maxwell distribution, so 
that ^ 0, 



D*-, ^ S*(V), and therefore 



lio = 

2nmivo(t) f 



K 



d'^ + d-2Jo 
nivQ (t) 



d 



r ds'(s*(s')-s*) 

Jo 



(4.56) 
(4.57) 

(4.58) 
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The difference occurring in the granular case (r < 1), with respect to the 
elastic the following: the averages (...) are based on an invariant 

measure /o which is not Maxwellian; the conjugated currents at time are 
different from the fluxes S* and D*j, as expected from the non-Gaussianity 
of the unperturbed state and from the considerations of section 3. The time 
integration is replaced by an integration over the average collision number s, 
and contains an additional time dependent factor. This term arises from the 
change of the temperature over the duration of the integral. 



4-3.2 Driven granular gases 

The effect of a uniform driving acting upon all the particles of the granular 
gas is modeled assimilating the driving to a thermal bath, on the macroscopic 
scale of grains (see Appendix A for details). All the variants of this thermal 
bath model guarantee the achievement of a statistically stationary state after 
the time needed to forget the state in which the system has been initially 
prepared. The study of the FDR in these models is recent and has been car- 
ried out by means of numerical simulations [115,116,117,118]. Some of the 
numerical results has received an analytical interpretation in [119], and ex- 
perimental verifications have been attempted in [120]. Other idealized models 
of inelastic energy exchange [121,122,123] have also been proposed. Some of 
the numerical results and their interpretation are reviewed here, in view of 
relation (3.9). We start with monodisperse weakly correlated systems, we con- 
tinue with the bidisperse case, and we conclude with an analysis of the effect 
of strong correlations in dense systems. 

Monodisperse gases with weak correlations 

A simple Fluctuation-Response experiment involving only one particle of a 

statistically stationary gas made of identical particles, consists in applying an 
instantaneous perturbation 6vo{0) to the x-component of the velocity of that 
particle at a time (assumed to be in the stationary regime), and observing 
its relaxation averaged over many different realizations: 



If the invariant measure describing the statistically stationary state satisfies 
the following condition (the independence of the degrees of freedom) 

N d 

p({v„x,}) = n^nnP^«)' (4-60) 

i=l a=l 

where vf is the a velocity component of the i-th particle, with n — N/V, and 
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if the single particle velocity pdf Pv{v) is a Gaussian, then Eq. (3.9) predicts 



Rit)=C,it) 



(4.61) 



for the response function. If one of these assumptions does not apply, then 
relation (4.61) is no more expected to hold. 
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Fig. 7. Dilute cases, velocity pdf in different cases. 

The above recipe has been applied [115,116,118] to three monodisperse vari- 
ants of the general model of driven granular gases of Appendix A, Eq. (A. 2), 
characterized by: 



i) very dilute conditions in 2D, with volume fraction 



n- 



< 0.1 (being 



a the diameter if the hard disks) and mean free time between collisions 
not much smaller than the viscosity time = I/7; 

ii) same as model i) but with the additional assumption that positions of 
particles are irrelevant and the probability of a collision is proportional to 
the relative velocity (Direct Simulation Monte Carlo, DSMC); 

iii) same as model ii), with a constant collision probability (inelastic Maxwell 
model) and a deterministic driving. 



The last two variants are discussed in details in Appendix A. All these models 
have the common property (4.60) and non-Gaussian velocity pdfs Pv{v)- In 
particular model iii) displays p^(f ) with high energy tails of the form with 
6 = 4 in (i = 1 [124,125] and 6 > 4 in c? = 2 (a good estimate for not too high 
inelasticity is 6 ~ 4/(1 — r) [126]). The extreme simplification of the dynam- 
ics of model iii) allows us to obtain a direct analytical computation of time 
correlations and responses (see Appendix A). In Figure 7, some examples of 
the velocity pdfs for these different models are shown. In Molecular Dynamics 
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(MD) simulations of inelastic hard disks, even if strongly inelastic, but still 
dilute {(f) < 0.1), the velocity pdf is not far from a Gaussian, as in a DSMC 
with similar choices of the parameters (tc ~ O.lr;,). Increasing n in the DSMC 
leads to stationary regimes very far from thermal equilibrium, with Tg <^ Tf, 
and larger tails of the velocity pdf Pv{v). A convenient fit of these velocity 
pdfs is the following 

p^{v) = Co exp(-cit;^ + C2\v^\ - CsW^) (4.62) 

where Cq is the normalization constant. In most of observed cases jcsv^^^l -C 
|c2fj^a2,|, with Vmax the largest value of v in the histogram. Therefore, in prac- 
tice, we have a rather good fit even dropping the quartic term. Using rela- 
tion (3.9) with the assumption of uncorrelated velocities, a prediction for the 
response is obtained, in the form 

R{t) = -2ci{v,{t)v,{0)) + 3c2{v,it)\v.M\v.m (4-63) 
= -2c^{vl)C,{t) + 3c2{\vM'\)C2{t), (4.64) 

which also defines C2(t). 




t 

Fig. 8. Dilute cases; experiment with instantaneous displacement of the velocity of 
a tracer. 

Typical results of Fluctuation- Response numerical experiments on these three 
models are shown in Figure 8, together with the normalized velocity correla- 
tions Ci(t) and C2{t). The general picture that emerges from these numerical 
experiments is the following: 

• different correlations practically display the same behavior (we do not show 
C3(t) = {v{t)v^{0))/{v{0)'^), but the result is similar) 
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a very good agreement between R{t) and Ci{t) is observed, which amounts 
to a verification, within the hmits of numerical precision, of the Einstein 
relation. 



The observation that the self-correlations Ck{t) are almost identical, at least 
for k = 1,2,3, is very robust: indeed with large statistics one can appreciate 
very small differences only at late times. Anyway, the data on the response 
function is usually quite noisy, and, for the practical purpose of the linear 
combination involved in the response, these small differences are negligible: 
the Einstein relation is always satisfied, with Tg as a proportionality factor. 
In conclusion, the coincidence between velocity correlations of different orders 
makes the non-Gaussianity of the velocity pdf irrelevant for the linear response 
of the system. 

It is interesting to note that an almost identical situation is encountered in 
a gas of non-interacting particles, whose velocities obey a Langevin equation 
with a non-quadratic potential: 



with U{v) — c\v^ — civ\v\^ -|- C2,v^ (with positive ci, C2 and C3). Numerical 
inspection, clearly indicates that Ci(i), Ciif) and C-iif) are practically indis- 
tinguishable. 

A simple condition produces the observed behavior. In fact, the time correla- 
tion of i'(i) with a generic function of the initial velocity /[t'(O)] can be written 
as 



where Vt{vt\vQ) is the conditional probability of observing v{t) = Vt if v{Q) = vq 
(time translation invariance is assumed) and {vt\vo) — J dvtVt{vt\vo)vt is the 
average of v{t) conditioned to v{0) — vq. 

If, for some reason, the dependence on time and on v{0) can be factorized, 
i.e. {vt\vo) = g{t)q{vo), with g and q two generic functions, then the time 
behavior results independent of the choice of the function f{v), i.e. of the 
order of the correlation. This happens in model (iii), where in spite of the 
non-Gaussian shape of the velocity pdf, the equivalence between R(t) and 
Ci(t), as well as any other correlation Cf{t) = {v{t)f[v{0)])/{v{0)f[v{0)]) = 
R(t) — exp ^ with any generic function / of the initial velocity value, 

is exact for the case d — 2 and [117] for d — 1, see Appendix A. 




(4.65) 



{v{t)f[v{0)]) ^ j dvt j dvoPy{vo)Vt{vt\vo)vtf[vo] 



(4.66) 




(4.67) 
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Let us discuss further experiments, with different kinds of perturbations, which 
involve more than one particle. A classical procedure, to avoid the heating of 
the system when a global perturbation is applied, is the following [44]: once 
a steady-state has been reached, the system is perturbed impulsively at time 
by a force applied (non-uniformly) on every particle. The response is then 
monitored in time. The force acting on particle i is 

F(r„t)=0^(r,,t) (4.68) 

with the properties Vx^^^O, V-^ = 0, where d is a particle dependent 
variable with randomly assigned ±1 values. A simple case is realized by a 
transverse perturbation ^(r,t) = {0,^cos{kxx)6{t)), where is compatible 
with the periodic boundary conditions, i.e. — 2Trnk/Lx with rik integer 
and Lx the linear horizontal box size. The staggered response function (i.e. 
the current induced at t by the perturbation at time 0), and the conjugate 
correlation, 

? i 

C{t) = (E yi{t)yM cos{k,[x,{t) - a;,(0)]}) 

i 

are related, at equilibrium, by the Kubo relation i?(t,to) = fC'(^,^o)) Tf, = 
1/13 being the bath temperature. It is possible to derive the same relation 
from Eq. (3.9) with the assumption of uncorrelated variables and Gaussian 
velocities, and replacing with Tg of the perturbed species. In Figure 9, the 
results of such numerical experiment are shown in a parametrized form. The 
previous scenario is recovered: the Kubo relation is satisfied with Tg replacing 

n. 

The binary mixture and the granular thermometer 

In the binary mixture case, one analyzes a system made of two different com- 
ponents with Ni and N2 particles, with masses mi and m2 respectively, co- 
efficients of restitution ccn and 0:22 for collisions among particles of the same 
species and ai2 for collisions among particles of different species. Simulations 
as well as experiments and analytical calculations have shown that, in this 
case, energy cquipartition is broken, i.e. T^ ^ T^ ^ T5 [127,128,129,130,131]. 
At the level of Boltzmann kinetic equation, the temperature ratio of a binary 
granular mixture subject to stochastic driving of the form given above has 
been obtained in [130] for the case = and in [127] for 7^. 7^ 0. In the 
case 7s- 7^ a bath temperature can still be defined as T5 = Y s^^g^. Note 
that in general F^^ and 7,5,. depend upon m.j and the correct elastic limit (i.e. 
cquipartition) is recovered if and only if T5 does not depend on m^. In [127] 
it has been shown that a model with F^. oc ^Jfn^^ and 7^,.. oc m^^ fairly repro- 
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Fig. 9. Parametric plot of R{t — tyj) vs. C{t — t^,) for the numerical experiment with 
recipe // (impulsive shear perturbation) with r < 1, with heating bath, and for 
different choices of the wave number of the perturbation. Tf, = 1 and = 10, 
N = 500, Tc = 1, S = 0.01, Uk = 8, with averages over 10000 realizations, using 

tyj = 100. 

duces experimental results for the temperature ratio T1/T2 measured in a gas 
of grains in a box vertically vibrated. It is also known that equipartition is not 
recovered even in the so-called tracer limit [132], i.e. in the case N2 = 1 and 
Ni ^ 1. For binary mixtures we discuss recent results [116] obtained for both 
molecular dynamics and DSMC. The above Fluctuation-Response experiment 
with a small perturbation introduced on a particle can be performed integrat- 
ing in time, measuring the mobility of a tracer particle and comparing it with 
its self-diffusion coefficient: this is useful to reduce noise in the measurement 
of the response function. The mobility of the tracer particle can be measured 
by applying a small constant drag force f^, in the x direction for instance 
to a given particle, labeled 0, for times t > (we assume the system to be 
isotropic) . The linearity of the response is always checked by changing the am- 
plitude of the perturbation. The perturbed particle will reach at large times a 
constant velocity /if^, related to the instantaneous response of Eq. (4.59) by 



The mean-square displacement averaged over many unperturbed dynamics 
B(t) = (|ro(t) — ro(O)p) asymptotically grows linearly in time, B{t) ~ 4Dt (in 
dimension d = 2) with a self-diffusion coefficient given by D = {v{t)v{0)) . 
Integrating the relation (4.61), one obtains a prediction for the mobility in the 




(4.69) 
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uncorrelated Gaussian case: 

= ^D, (4.70) 

s 

where Ts is the granular temperature of the species that the perturbed particle 
belongs to. 

The general result for a binary mixture [116] is analogous to the one for 
monodisperse gases: even when the velocity pdf is non Gaussian, the closeness 
between correlations of different order makes relation (4.70) true. By using as 
test particle a particle with index 1 (2) for species 1 (2), one obtains the two re- 
sponses xi = xi{t) - xi{0) ~ {6vi)oot and X2 = X2{t) - 2:2(0) ~ (^^2)00^, and 
thus the mobilities /ii and 112- Two independent Einstein relations (/Xj = Di/Ti) 
are verified, by plotting Xi vs. B^. In figure 10 we show, as an example, the 
verification of the validity of Green-Kubo relations using DSMC in spatially 
homogeneous regime. All the experiments, performed varying the restitution 
coefficients and the masses of the two components, and with different models 
and algorithms (homogeneous and non-homogeneous, DSMC and MD) showed 
identical results, i.e the linearity of response-perturbation relation with effec- 
tive temperature equal to the granular temperature of the perturbed species. 
The same is true for other kinds of perturbation, such as the current-shear 
perturbation experiment discussed above. 

In figure 11 an even more striking result is portrayed: the mobility-diffusion 
parametric graph is shown in the case of a single tracer with different prop- 
erties with respect to a bulk gas (A^i = 500, N2 = 1). In this case the tracer 
does not perturb significantly the bulk. However the temperature of the tracer 
is quite different from the bath temperature as well as from the gas temper- 
ature [132]. Again, the effective temperature of the tracer corresponds to its 
temperature and not to the temperature of the bath or of the bulk. That is 
to say that a non-perturbing thermometer, used to measure temperature of a 
granular gas through Fluctuation-Response relations, would measure its own 
temperature and not the bulk temperature. This is a consequence of the lack 
of thermalization, or equipartition, due to energy dissipating collisions which 
characterize stationary states of granular systems. 

Failure of the Einstein relation: correlated degrees of freedom 

The factorization of the invariant phase space measure, Eq. (4.60), is no more 
obvious in model (i) when density increases. Correlations between different de- 
grees of freedom (d.o.f.), that is positions and velocities of the same or of differ- 
ent particles, appear also in homogeneously driven granular gases, as an effect 
of the inelastic collisions that act similarly to an attractive potential. Such a 
phenomenon has been discussed for this model of bath in [133,134,135,136] and 
for other homogeneous thermostats in [137,138,139]. In [133,134] it was also 
discussed the interplay between local density and local granular temperature, 
which in some very dissipative cases present strong fluctuations correlated to 
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Fig. 10. Binary mixture, homogeneous DSMC: mobility vs. mean-square displace- 
ment; left: ail = 0.3, ai2 = 0.5, 022 = 0.7, 1712 = 3mi, Ti « 0.2, T2 ~ 0.38; right: 
CKii = (^12 = (X22 = 0.9, 1712 = 5mi, Ti 0.035, T2 ~ 0.05. Symbols are numerical 
data, lines have slope l/(2ri) and 1/{2T2). 
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Fig. 11. Binary mixture, homogeneous DSMC: mobility Vs. diffusion of a single 
particle of mass mtracer in contact with N = 500 particles of mass m, immersed 
in a heat bath (i.e. random kicks plus viscosity). We use the following conventions: 
(^tracer = «12 and a = On. Only in case A) the tracer is also in contact with the 
external driving heat bath. A) mtracer = m, a = 0.9, atracer = 0.4, Tg = 0.86, 

^tracer ^ g.TO; B) mtracer = m, a = 0.9, atracer = 0.4, Tg = 0.86, Tf "^^'^ = 0.46; 
C) mtracer = 7m, a = atracer = 0.7, Tg = 0.74, T*/^^^' = 0.60; D) mtracer = ^m, 

'^^'^^^ the 



a = atracer = 0.7, Tg = 0.74, T, 
dashed line has slope Tg. 



tracer 
9 



Lg, — V... ^g 

0.57. The solid line has slope T* 



each other. These correlations indicate a breakdown of the factorization of the 
invariant measure, in particular the velocity and the position distributions of 
a given particle do not factorize. In general, even when relation (4.60) does not 
hold, one can define (and compute) the marginal probability density function 
of the component x of the velocity of one particle i, as the marginalized of 
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Fig. 12. Left: correlation functions and response. Right: velocity pdf. Both plots 
refer to the case of a dense granular gas 
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p({vi,Xi}): 

P^:\v,) = f II d^, n t/vfcrft;fp({v,x}). (4.71) 

k=l k=l,k^i 

However not always does this function play a direct role in the response func- 
tion. For example, perturbing the x component of the velocity of the i-ih 
particle and measuring the response of the same component, one obtains 



R{t) 



91np({v,x}) 



dvf 



t=o/ 



dvf 



(4.72) 



t=o/ 



This is exactly what happens in model (i) (here we discuss only the monodis- 
perse case [118]) when density is increased. In Figure 12, left frame, the corre- 
lation functions Ci{t) and C2{t) are shown, together with the response func- 
tion measured with different values of the perturbation 6v{0). The very good 
agreement between different response functions guarantees that the system is 
indeed linearly perturbed. At the same time, the different correlation func- 
tions Ck(t) are very close, reproducing the phenomenology already observed 
in the previous dilute cases, with the difference that the time dependence is 
not exponential but slower, closer to a stretched exponential ~ exp(— (t/r)") 
with a < 1. Finally, looking at the velocity pdf of the gas, the previously 
proposed exponential of a cubic expression, Eq. (4.62) with a negligible C3 
coefficient, is found to perfectly fit the numerical results. Therefore, if the cor- 
relations among the different d.o.f. are neglected, using equation (4.63) and the 
proportionality of the functions Cn{t), a verification of the Einstein formula 
R(t) = Ci(t) is still expected. The results displayed in Figure 12, left frame, 
demonstrate that this is not the case: the hypothesis of weak correlations 
among different d.o.f. is not appropriate and the correct response function is 
given by Eq. (4.72). 



67 




The degree of violation of the Einstein formula increases with the volume 
fraction and the inelasticity 1 — r, as shown in Figure 13, where the ratio 
R{t)/Ci{t) is reported as a function of time. This observation is consistent 
with the above argument: correlations among different d.o.f. increase when the 
probability of repeated contacts (the so-called "ring collisions") is enhanced, 
and this happens when the excluded volume is reduced as well as when the 
post-coUisional relative velocity is reduced. 

A linear model with two correlated variables 

It is interesting to discuss a simple model with only two d.o.f. with Gaus- 
sian marginalized pdfs. The two variables, x, y, obey the following system of 
coupled Langevin equations: 



miix(t) + mi2v{t) + (Tii?7i(t) + ai2T]2{t) (4.73) 
m2ix{t) + m22v{t) + a2i?7i(t) + a22V2{t) (4.74) 

When the matrices rh and a are diagonal, the two variables are independent. 
Otherwise, they are correlated. Provided that the matrix m is negative definite 
and det a 7^ 0, the pdf of the two variables relaxes toward an invariant joint 
pdf, given by a bivariate Gaussian function. Instead of discussing the general 
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Fig. 14. Response R{t) and velocity correlation Ci{t) in the simple Langevin model 
with correlated variables discussed in Eq. (4.73), with parameters mn = —1.1, 

mi2 = m21 = 0.8, 772-22 = -1- 

case, we suppose that the invariant joint pdf is expressed by 



The marginal pdf of each variable is then a Gaussian. Neglecting the corre- 
lation among x and v, the response of f to a perturbation, would again be 
expected to be equal to Ci(t) = {v(t)v{0))/ {v^). On the contrary, the correct 
response is given through the full formula (3.9), applied to the joint pdf (4.75). 
The result is 



The difference between the Einstein formula and the correct response is shown 
in Figure 14 for one choice of the matrix m. 



The role of spatial inhomogeneity 

Inspired by a work about violations of the Einstein relation in a non equilib- 
rium model [140], it is natural to conjecture an effective spatial dependence 
of the pdf of the velocity component for a particle at position x, at time t of 




(4.75) 




(4.76) 
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Fig. 15. Response R{t) and different correlation functions for the same MD sim- 
ulation discussed in Figure 12. The normalized velocity self-correlations Ci{t), as 
well as the correlation Cs{t) defined in Eq. (4.78), for different values of the coarse 
graining radius Lbox are reported. 



the form 



p„(t;,x,t) ~ exp 



2T„ 



(4.77) 



where m(x, t) is a local velocity average, defined on a small cell of diameter Lbox 
centered in the particle. Such a hypothesis is motivated by the fact that, at 
high density or inelasticities, spatially structured velocity fluctuations appear 
in the system for some time, even in the presence of external noise [138,139]. 
Following relation (3.9), with the ansatz (4.77), a formula for the response 
function follows: 



Rit) = Cs = ^{vit){viO)-u[^m}). 



(4.78) 



Figure 15 shows that relation (4.78) is fairly verified. Note however that the 
proposed form (4.77) cannot be completely exact, a spatial dependence of Tg 
should also be included. 
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4-4 Further applications 



4-4-1 Nano-sy stems 

Since the early 60's, technology follows a trend towards miniaturization, which 
has led to the construction of devices of the size of a few tens of nanometers, 
or smaller. In some circumstances, these devices are built by assembling single 
molecule after single molecule. While technology at the /xm scale is known to be 
more sophisticated, but not substantially different from the macroscopic world 
technology, it is universally believed that nanotechnology has to face physical 
features which are quite different from those of the macroscopic world, espe- 
cially when it comes to devices whose parts are made of an order 0(1) up to 
O(IO^) atoms or molecules. In itself, this does not look particularly surprising. 
Indeed, macroscopic bodies owe their properties to the very large number of 
their microscopic constituents, and to the fact that these constituents interact 
with each other, in very precise fashions. This allows the onset of the state of 
local thermodynamic equilibrium (when the driving forces are not too large) 
and of its consequences, like the vahdity of the hydrodynamic laws. The fact 
that the microscopic constituents of small systems, like nano-deviccs, obey the 
same dynamical laws as those of the constituents of a macroscopic body is not 
sufficient for the small systems to behave as macroscopic objects. Landau and 
Lifshitz express this concept as follows [141]: 

"At first sight, one may conclude that the growth of the number of particles 
makes infinitely complicated and intricate the properties of the mechanical sys- 
tem at hand, so much that it becomes impossible to discover any guiding law 
in the behaviour of the resulting macroscopic body. But this is not the case 
and, as we will see below, new and very special laws emerge for a very large 
number of particles. 

These are the so-called statistical laws which are due precisely to the exceed- 
ingly large number of particles of which the body is made. These laws are in 
no way reducible to mechanical laws, their specific characteristic is that they 
make no sense for mechanical systems of a small number of degrees of freedom. 
Therefore, the presence of many degrees of freedom implies substantially dif- 
ferent laws, even though the motion of a system with many degrees of freedom 
follows the same mechanical laws of a system of a few degrees of freedom." 

In particular, the hydrodynamic laws exclude that macroscopic observables 
may spontaneously fluctuate: this is considered possible, but practically irrel- 
evant, in many-particles systems. Differently, fluctuations are not negligible in 
small systems or in small parts of macroscopic systems, where they might be 
directly observable [142,143]. 

Nano-technological devices are then expected to behave differently from ther- 
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modynamic systems. Among them, we find, for instance, quantum dots, carbon 
nano-tubes and molecular machines, whose sizes range from a few to O(IOO) 
nanometers. The question is: which are the laws that describe the behaviour 
of such small systems? This question is particularly important not only for its 
nano-technological imphcations, see e.g. Ref.[144], but also for understanding 
from a fundamental point of view the behaviour of microscopic systems in 
general and, in particular, biological systems. Indeed, bacteria and cells arc 
quite larger than the few tens of nm which qualify nanosystems, but their be- 
haviour is determined by events that occur at the nanoscale, like the transport 
of matter through the cell's membrane. 

At the moment there is no clear answer to the above question. However, a 
widely shared view is that the mechanical laws, which are overshadowed by 
the statistical laws in macroscopic systems, should play an important role 
in nanosystems, hence it appears promising to explore the nano-world from a 
dynamical systems point of view. In particular, the fluctuation relations which 
are the object of Section 5 are expected to be applicable to nano-phenomena. 
Indeed they have been tested and verified to various extents [142,143], as 
discussed in Section 5. The study of granular systems, in turn, may provide 
insights on the above questions, since they would be mesoscopic objects, were 
their grains of the size of atoms or molecules. 



4 -4 -2 Fluctuations and response in biological systems 

Some applications of linear response theory to biological systems have been 
recently discussed by Kancko and co-workers [145,146]. The idea is that fluc- 
tuations, always present in living organisms, are relevant for the response of 
average properties to changes in the environment. Environmental conditions 
can be seen as parameters determining the distribution of fluctuations of mea- 
surable quantities: for example, the concentration of a protein in a cell, as well 
as its fluctuations, are influenced by many parameters, such as temperature, 
pH value and so on. When an external perturbation is switched on, the pa- 
rameters change and the distributions of biological variables respond in some 
way. A general relation for this response can be derived: in the following, for 
simplicity but without loss of generality, we assume that the distribution of 
fluctuations can be approximated by a Gaussian, and we discuss the case of a 
scalar external parameter a and a unique scalar observable x. Upon a change 
Aa of the parameter, the distribution of x changes from Pa{x) to Pa+Aa{x), 
which can be written as 

Pa+Aa{x) = Pa{x) e^" Aa W -1° W = p^(x) e^(»'^"'^) . (4.79) 
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The Gaussian assumption allows us to neglect the powers of x higher than x'^ 
in the expansion of e(a, Aa, x) — In Pa+Aa{-c) — In Pa{x), obtaining 

Pa+Aaix) = p^(a;)iVe^*'^(»'^»)(^-<^>»)+^^''^(«'^«)(^-<=^)<')', (4.80) 

where e*^") = {d''^e{a, Aa, x) /dx^'')\x={x)a and = e''^"''. Using this formula to 
calculate {x)a+Aa, the average of x in the perturbed system, one obtains: 

{x)a+Aa - {x)a = e^^\a, Aa)(7^ ~ b{a)alAa (4.81) 

where the first order in the parameter change has been considered, introducing 
b{a) = de^^\a,Aa)/dAa\Aa=o, and = {{x - {x)ay)- Equation (4.81) is a 
particular case of FDR, and in fact can be derived from the generalized rela- 
tion (3.9): it does not require thermal equilibrium, but only the quasi-Gaussian 
assumption on p{x). It must be noted, however, that in relation (4.81) the co- 
efficient b{a) can in principle be related to a^. 

An experimental proof of relation (4.81) has been obtained studying the phe- 
notype response to the exertion of an artificial selection pressure over the 
genotype of a population of E. Coli bacteria. The fiuorescence intensity of the 
Green Fluorescent Protein (GFP) has been used as a marker of the pheno- 
type state x. The external force has been identified as the selection pressure, 
providing a constant rate of variation of the genotype, taken as the parame- 
ter a. The distribution of fluctuations of the fluorescence intensity Pa{x) has 
been measured in successive generations during the application of the exter- 
nal force. To apply the above relation, the DNA sequence of genes in the cell 
is regarded as a parameter influencing the variables of the cell system, i.e. 
the phenotype. The measured distribution Pa{x) provides the average {x)a as 
well as its variance a^. The proposed relation (4.81), with a coefficient b not 
dependent on a, has been validated by these experimental data. 

The above experiment probes the relevance of phenotype fiuctuations among 
clones, i.e. organisms with identical genes: these fluctuations are always pos- 
sible because living cells are of finite size and at finite temperature. In nature, 
however, genetic diversity is the norm: the parameter a is not single valued 
in a population, but is distributed around a mean. The variance of phenotype 
fiuctuations is then also induced by genotype variability. It is this variance 
that was considered by Sir Ronald Fisher in his celebrated fundamental theo- 
rem of natural selection [147], which asserts that evolution speed and genetic 
variance are proportional. Even if the phenotipic variance of the clones, V^p, is 
not equivalent to that of phenotypes in a genetically diverse population, Vg, 
they have been shown to be related in [146]. There, an inequality has been 
derived, stating that 

Vg < (4.82) 
only assuming that the phenotype distribution is single-peaked and not too 
broad, which is equivalent to require a robustness of the mean phenotype to 
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genotype fluctuations. The equality sign in Eq. (4.82) holds in the limit of high 

evolution speed, just before the appearance of the error catastrophe, where the 
phenotype distribution becomes too broad and the single-peak assumption 
fails. 

Concluding, we can say that Fisher's theorem is somehow a biological version 
of a general form of FDR. Let us stress the formal analogy with statistical 
mechanics, whose small fluctuations of macroscopic variables can actually be 
detected from the response functions. Analogously, in biology the fluctuations 
of the genotype variables, which are the corresponding "microscopic" quanti- 
ties, can be understood from the phenotype features. 



5 Fluctuation relations 



While the theory of fluctuations around equilibrium states can be considered 
quite satisfactory and complete, the same cannot be said of the nonequilibrium 
theory. In this context, the 1993 paper by Evans et al. [148], on the fluctuations 
of the entropy production rate, has been a pioneering attempt towards a uni- 
fied theory of a wide range of nonequilibrium phenomena [149] . The relation 
proposed and tested in [148] is nowadays merely called Fluctuation Relation 
(FR). It constitutes one of the few general exact results, obtained on purely 
dynamical grounds, for systems almost arbitrarily far from equilibrium, and 
close to equilibrium it is consistent with the Green-Kubo and Onsager rela- 
tions. A considerable number of works have been devoted to it, and various 
authors have derived it in different ways (e.g. [150,151,152,153]). 



The FR of Ref.[148] reads 

Prob.(A) 



Prob^(-^) 

where A and —A are averages of the normalized power dissipated in a driven 
system, in a long time r, and Prob^(±A) is the steady state probability of 
observing values close to ±^4. The relation was derived for the following isoen- 
ergetic model of a 2-dimensional shearing fluid: 



' d Pi 
dt m 



d T-, / \ (v)- 
—Pi = Fi(q) + 7pf - athPi 
\ dt 



(5.2) 



where F = (qi, Pi, Qat, Pat) represents one point in phase space, 7 is the 
shear rate in the y direction, x is the unit vector in the x-direction, and the 
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friction term ath (also called "thermostat" ) takes the form 



N 

M^) - EpS^V?^ (5-3) 

2^1=1 Pi i=l 

determined by Gauss' principle of least constraint (cf. Subsection 5.3). In this 
popular molecular dynamics model, the phase space contraction rate, defined 
by 

k i dq\ dp\ ' 

is proportional to the "thermostat" ath, hence to a quantity Q, which is the ir- 
reversible entropy production, or the energy dissipation rate, divided by X^p?. 

Evans and Searles focused on the fluctuation properties of ^2 [151,154,155,156,157,158], 
which differs from A in most cases. They obtained "transient" FRs, which hold 
under the sole condition of reversibility of the microscopic dynamics. The term 
transient means that such relations concern the statistics of evolving ensem- 
bles of trajectories, rather than that of the steady states. These authors argued 
that, in the long r limit, the same relations describe the steady state fluctu- 
ations. We call fi-FR's these relations, which will be described in subsection 
5.3.2. 

Gallavotti and Cohen provided the mathematical setting for the results of 
Ref.[148], introducing the Chaotic Hypothesis [150,159,160]: 



Chaotic Hypothesis: A reversible many-particle system in a stationary state 
can be regarded as a transitive Anosov system (cf. Appendix C) for the purpose 
of computing its macroscopic properties. 



The result is a steady state PR for the fluctuations of A, which we call A- 
FR, and we describe in subsection 5.3.1. Such a strong assumption as the 
Chaotic Hypothesis raised the question of which models of physical interest are 
"Anosov-like" , since almost none of them is actually Anosov (lack of uniform 
hyperbolicity being usual). The idea was that the Anosov property, analo- 
gously to the Ergodic property, could hold "in practice" . This view faces some 
difficulties which are evidenced and tackled, for example, in Refs.[161,162]. 

Other relations which concern the statistics of nonequilibrium systems, and 
have generated much interest, are the Jarzynski and Crooks relations; they 
belong to the class of transient FRs, and relate free energy differences be- 
tween equilibrium states to non-equilibrium processes [163], as described in 
subsection 5.3.3. 

The derivation of the FR's for deterministic systems motivated stochastic ap- 
proaches, beginning with Kurchan's work [164]. Among these studies, Ref. [165] 
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has to be singled out since it solved, in a special difficulty of systems 

with infinite state spaces, which are quite common. The works by Bodineau 
and Derrida [166], and by Jona-Lasinio and coworkers [167] also treat fiuc- 
tuations in stochastic systems, but develop different theories, hence will be 
discussed separately in Section 7. 

We do not attempt an exhaustive review of this subject: we focus mainly on the 
papers which initiated the various research lines. Because entropy production 
is one of the quantities which are most investigated in this context, we begin 
recalling basic facts of Irreversible ThermodjTiamics. After that, we describe 
the models in which the FRs were first considered. 

5. 1 Irreversible entropy production 

The main object of the FR's is the irreversible entropy production, for systems 
in Local Thermodynamic Equilibrium (LTE), or the energy dissipation rate, 
more in general. 

Irreversible Thermodynamics can be applied to systems that satisfy LTE [26]. 
Physically, LTE is due to the local exchange of momentum and energy in many 
particle collisions, leading to a local Maxwell velocity distribution and local 
thermodynamics. This allows one to assume that the specific (i.e., per unit 
mass) local entropy s at a position r = (ri,r2,r3) at time t is a function of 
the local specific energy -u, of the local mass density n, and of the local mass 
fractions c = {cj}f^^ of the k constituents out of which the system consists, 
as it is in equilibrium. In other words, LTE implies 

s(r, t) = s[u{r, t), n(r, t), c(r, t)] , (5.5) 

and 

k 

Tds = du + pdv — ^ fiidci (5.6) 
1=1 

where p is the pressure, v = 1/n is the specific volumj"!. and /Xj the chemical 
potential of component i. In particular, LTE assumes that Eq.(5.6) remains 
valid for a mass element followed along its center of mass motion, even if the 
total system is not in equilibrium, so that one can write: 

k 

TDtS = Dtu + pDtV - fiiDtCi (5.7) 

1=1 

where, denoting with v(x, t) the macroscopic velocity, 

Dt = ^t + ^r■Vr 
In other words, v is the volume per unit mass. 
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is the (barycentric) substantial time derivative [26]. It turns out that LTE 
holds for a wide variety of transport phenomena. 

The hydrodynamical equations are based on LTE, as well as on the local 
conservation laws for u, v and the q's. Assuming local linear laws for their 
fluxes, one obtains, for instance. Pick's law for tracer diffusion, with local flux 
J: 

3{r,t) = -D Vr n{r,t) (5.8) 

where Vr^ is the local density gradient, and D the diffusion coefficient For 
viscosity, the local flux is given by Newton's law, and is expressed by 

J.,(r,t) = -r^^(r,t) (5.9) 

where Jij is the ij-component of the local pressure tensor, giving the flow of 
the j-component of the local momentum of a fluid in the rj-direction, sheared 
by a linear local velocity gradient duj/dvi, and rj is the viscosity coefficient. 
Similarly, one obtains all the other linear laws of Irreversible Thermodynamics. 
It is worth pointing out that states described by nonlinear laws, for the local 
quantities mentioned here, may be necessary in the presence of strong external 
forces and gradients, but this does not mean that LTE is broken: as long as 
one can properly speak of local thermodynamic quantities, LTE must hold. 

Equation (5.7) and the hydrodynamic equations lead then to the entropy 
balance equation for the local variation of the entropy density: 

n{v, t) As(r, t) = - div J,(r, t) + a,(r, t) , (5.10) 

where is the local entropy flux, and 0"^ > is the local irreversible entropy 
production. This is a quantity related to the dissipated energy, hence should 
not be confused for the mere entropy variation, which takes place even in dissi- 
pationless phenomena, and does not need LTE. Indeed, in the linear regime, as 
is usually written as J2i^iJi, where Xj and Jj are conjugate thermodynamic 
forces and fluxes, respectively. 

5.2 Ergodic hypothesis: the Khinchin's approach 

As in the study of equilibrium phenomena, it is desirable to develop a mi- 
croscopic interpretation of the macroscopic theory outlined above, in order 
to extend our understanding beyond the realm of the previous subsection. To 
connect the theory of irreversible thermodynamics with a microscopic descrip- 
tion, in analogy with equilibrium statistical mechanics, models are needed to 

More in general, D may be a tensor. 
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assess the various hypothesis and to derive relations of practical interest. In- 
deed, while the equilibrium theory is solidly based on the Gibbs ensembles 
and on the Ergodic Hypothesis, the noncquilibrium counterparts of these en- 
sembles and hypotheses are not identified yet, although various proposals have 
been made in the literature. Before we continue, it is therefore useful to recall 
how the microscopic description of equilibrium phenomena is based on the 
Ergodic Hypothesis, following Khinchin's approach [168]. This will suggest 
possible avenues of investigation, for the case of noncquilibrium phenomena. 

Khinchin looked at the ergodic problem from a physical perspective, avoiding 
the physically scarcely relevant concept of metrical transitivity, implied by the 
Birkhoff theorem. His general idea stems from the following facts: 

a) statistical mechanics concerns systems with a large number of degrees of 
freedom; 

b) the physical obscrvables are not generic (in mathematical sense) functions; 

c) it is physically acceptable that ensemble averages do not coincide with time 
averages, for sets of initial conditions F of measure tending to zero when 

^ oo. 

Khinchin considers systems with a separable Hamiltonian, i.e. systems whose 
Hamiltonian can be written as 

N 

H ifn(qn,Pn) 

n=l 

and a special class of observables (called sum functions) of the form 

N 

/(r) = E/n(qn,Pn) 

n=l 

where /„ = 0(1). The pressure, the kinetic energy and the single-particle 
distribution function are examples of sum functions. 

Denote by ( ) the microcanonical ensemble average, and let fiV) be the time 
average of the observable /, along a trajectory starting at V. Under quite 
general hypotheses, and without invoking any metrical transitivity, Khinchin 
showed that the following holds: 

where Ki and K2 are 0(1). This means that ensemble averages of sum func- 
tions differ more than a given tolerance from time averages, only along trajec- 
tories whose initial conditions have vanishing measure in the — 00 limit. 
Mazur and van der Linden [169] extended this result to systems of particles 
interacting through short range potentials. 
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This shows that the details of the phase space dynamics (i.e. of the microscopic 
dynamics) are practically irrelevant for a notion of ergodicity that describes 
physical systems and, indeed, they must be irrelevant for the thermodynamic 
behaviour to be as common as it is. In Khinchin's theory, the good statistical 
properties that are required are mainly explained as consequences of the fact 
that N is very large. 



5.3 Molecular dynamics models 

The models developed in nonequilibrium molecular dynamics (NEMD) have 
been adopted, in the development of microscopic theories of irreversible ther- 
modynamics, because they arc sufficiently simple to be analyzed in detail, and 
because of their success in describing various properties of nonequilibrium flu- 
ids and solids [17,170]. It is known that results produced by simulations of 
these systems are not reliable if quantum mechanical effects are important, 
if the inter-atomic forces are too complicated or insufficiently known, if the 
number of particles needs to be too large, or the simulations time too long. 
But NEMD models are otherwise appropriate in computing quantities such as 
transport coefficients, and are a valid alternative to experiments. Furthermore, 
the FRs were first conceived and investigated in one such model. The range of 
properties of a given physical system which they can describe, however, is not 
clearly delineated, and care should be used if the property under investiga- 
tion is directly afi'ected by the fictitious forces which characterize NEMD. The 
simplest NEMD models are derived from Gauss' principle of least constraint 



Gauss Principle (1829): Consider N point particles of mass mi,...,mN, 

subjected to frictionless bilateral constraints Cj and to external forces Fj. 
Among all motions allowed by the constraints, the natural one minimizes 
the "curvature" , defined by 



In the case of holonomic constraints, the equations of motion are Hamiltonian 
while non-holonomic constraints lead to non-Hamiltonian equations. The isoki- 
netic (IK) constraint, which fixes the kinetic energy 

K = Ei Pif^m, and the 
isoenergetic (IE) constraint, which fixes the internal energy Hq — K + 



[171,17]: 
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being the interaction potential, yield: 

' d_ _ Pi 

dt * m 



i = l,...,N (5.11) 



. dt 



'^p, = Fr*(q) + Fr*(q)-a,^(r)p, 



where F*"*(q) and F|^*(q) respectively denote the interactions among the par- 
ticles and the external force driving the system. In particular, for F|^*(q) = 
CjFe, where Cj is a charge coupling particle i to the external field Fe, and 
J = 12^=1 Ci{dqi/dt), 



athiT) = aiKiT) = -L ( j . + ■ Ff*) preserves K , (5.12) 

ath(T) = a/ij(r) = —J ■ Fe preserves Hq . (5.13) 

ZK 

In the case of the SLLOD model, defined by Eqs.(5.2), one has: 

N ^. N 



1 

«/^(r) = ^ E {FT' ■ P^ - iiT^i^) , «,^(r) = EpS^V?^ . 

(5.14) 



In the above examples, ajE is the energy dissipation rate divided by the ki- 
netic energy which, in local equilibrium, becomes the entropy production rate. 
Because A = — div [dV /dt) is in turn proportional to ajE-, A can be identified 
with the entropy production rate. However, real systems in nonequilibrium 
steady states can hardly be isoenergetic, and this identification appears to be 
accidental and of too limited validity. 

Depending on the physical property to be described, other constraints can 
be used; e.g. isobaric, isochoric, isoenthalpic, constant stress constraints. The 
deterministic term —athV is meant to add or remove energy from the system, 
to balance the action of the driving forces, so that a steady state can be 



reached [17] QH. This constraint has no immediate physical meaning; it merely 
serves the purpose of replacing the many (practically impossible to treat) 
degrees of freedom of a real thermostat, without appreciably perturbing the 
properties of interest of the system under investigation. For quantities not 
affected by how energy is removed from the system, its form is irrelevant and 
various mechanical constraints will do [17,170,172]. The introduction of one or 
another such constraint in the equations of motion is analogous to the choice of 



This form of deterministic "thermostat" is computationally efficient, and makes 
the equations of motion time reversal invariant [17]. 
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one numerical algorithm or another, for the solution of a given mathematical 
problem: one must choose the constraint or the algorithm which alters as little 
as possible the quantity to be computed. The introduction of hyperviscosities 
in the modellization of turbulence is another analogous procedure. 

Constant internal energy Hq or constant kinetic energy K, which prevent the 
system from indefinitely "heating up" , are popular constraints. The resulting 
systems are not Hamiltonian, but a Hamiltonian structure is not to be ex- 
pected in systems in nonequilibrium steady states, if the thermostat degrees 
of freedom are not included [173]. Indeed, a complete A^-particle model of a 
system and of its thermostat consists of Hamiltonian equations, which may 
be written as: 




G(r) 



G's(rs, Tr 



(5.15) 



where = {qi,Pi}, i = l,...,Ns, Tr = {q.i,Pi}, i = Ns + l,...,N, and the 
subscript s refers to the A^^ particles of the thermostatted system, while the 
subscript r refers to the A^^. = N — Ng particles of the reservoir. Moreover, 
if the time reversed evolution is allowed in phase space, it is also allowed in 
the projected space. As the reservoirs remove energy from a driven system. 



on average, the projected dynamics must be dissipative. LllJ Something similar 
happens in NEMD models, hence their non-Hamiltonian nature is not a hin- 
drance, by itself. However, NEMD models are not obtained through the ideal 
projection procedure, and have been developed for specific practical purposes. 
Therefore, they must be used with care [174,63]. 

Another popular deterministic model is the Nose-Hoover thermostat [17], de- 
fined by: 

dqi Pi dpi int,-r.ext . 1 f Kjp) \ , . 

^ = m' -dr = ^^ -^P- Tt = e[-W-')' ^^-'^^ 

where Kq is the chosen average of the kinetic energy K{p), and 6' is a relaxation 
time. Normally, particles interact, the dissipation is not too high and the 
dynamics are sufficiently ergodic that the initial value of ^ does not matter. 
In the small 6 limit. Nose- Hoover approximates Gaussian IK dynamics, but 
is more realistic and, in equilibrium, it generates canonical distributions as 
appropriate for macroscopic isothermal systems. 

The models illustrated above, like many others developed in NEMD, contain 
artificial forces, which are not present in Nature. The fact that they accurately 
describe certain properties of real systems, nonetheless, suggests that a form 



Systems of non-interacting particles behave differently: usually projection leaves 
the dynamics Hamiltonian. 
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of equivalence of ensembles may be envisaged in nonequilibrium statistical 
mechanics. Several works have been devoted to clarify this issue. The first of 
them, as far as we know, are due to Evans and Morriss [175,17]. For the equiva- 
lence of various thermostatted responses, see Refs. [176,177,172,178,179], while 
[178,179] show that the phase space dimensionality loss, due to dissipation, 
is a bulk phenomenon even when the thermostat acts only on the boundaries 
[180]. Other aspects of the equivalence of deterministic thermostats are dis- 
cussed in [181,132]. In practice, one finds that response to external drivings 
is not too sensitive to the choice of the thermostatting mechanisms and that, 
in some cases, the equivalence of behaviors reaches rather subtle dynamical 
properties [182,183,174]. 



5.4 Deterministic systems: transient and steady state relations 



In this Section, we discuss three sets of fluctuation relations, part of which 
concerns steady states, while the others describe properties of transient states 
arbitrarily far form equilibrium. The Gallavotti-Cohen and the steady state 
Evans-Searles approaches lead to steady state relations. The transient Evans- 
Searles, the Jarzynski and the Crooks approaches lead to transient relations. 



5.4-1 The Gallavotti-Cohen approach 

The idea proposed by Gallavotti and Cohen [150], is that dissipative, re- 
versible, transitive Anosov maps (cf. Appendix C) are idealizations of nonequi- 
librium particle systems, hence that properties like the A-FR are enjoyed by 
physical systems as well. That the system evolves with discrete or continu- 
ous time, was thought to be a side issue in [150], as apparently confirmed 
by Gentile's derivation for continuous time [184]. The proof of the A-FR for 
such rnaps followed these steps. First of all, it is known [185] that one Anosov 



map 51111 admits a special kind of partition of its phase space A4, which is 
called Markovian. This is a subdivision of Ai in cells whose interiors are dis- 
joint from each other, and whose boundaries are invariant sets constructed 
using the stable and unstable manifolds. Consequently, the interior of a cell 
is mapped by S in the interior of other cells, and not across two cells, which 
would include a piece of their boundary. Furthermore, arbitrarily fine parti- 
tions can be constructed, exploiting the time reversibility of the dynamics. 
Gallavotti and Cohen further assume that the dynamics is transitive, i.e. that 
a typical trajectory explores all regions of A^, as finely as one wishes. It is this 
structure that guarantees that probability weights of the kind conjectured in 



We denote by S^X the evolution that S implies from the initial condition X{0) 
X, i.e. X{1) = SX, X{2) = S^X, etc. 
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[148], cf. Eq.(C.3), from which the A-FR follows, can be assigned to the cells 
of a finite Markov partition. 



More precisely, let A(X) = — log J(X), where J is the Jacobian determinant 
of S\}^ and consider the probability (or frequency of observation along one 
steady state trajectory) of the dimensionless phase space contraction rate, 
obtained along a trajectory segment Wx,t) of origin X E M. and duration r. 
This quantity is defined by 

e.(X) = -i- 'f:' A(S^X) (5.17) 

\ ' fc=— t/2 

where (.) is the phase space average, with respect to the steady state proba- 
bility distribution. Let J" be the Jacobian determinant of 5* restricted to the 
unstable manifold , i.e. the product of the asymptotic factors of separation 
of nearby points, along the directions in which distances asymptotically grow 
at an exponential rate. // the system is Anosov, the probability that er{X) 
falls in Bpj. = {p — e,p + e) coincides, in the limit of fine Markov partitions 
and long r's, with the sum of the weights 

(5.18) 

of the cells containing the points X such that er{X) G Bp^^. Then, if rtriBp^^) 
is the corresponding probability, one can write 

7r.(e.(X) G Sp,,) ^ Wx,r (5.19) 

where M is a normalization constant. // the support of the physical measure 
is Ai, which is the case if the dissipation is not exceedingly high [186], time 
reversibility guarantees that the support of tt^ is an interval [—p*,p*], p* > 0, 
and one can consider the ratio 

'^rjBp^^) Y.XMX)&Bp,,U!x,T (r:nn\ 

TTrl^-p.J l^X,eriX)£B-p,,Wx,T 

where each X in the numerator has a counterpart in the denominator. Denot- 
ing by / the involution which replaces the initial condition of one trajectory 



^^If the point X has d coordinates, Xj, i = l,...,d, we can write Xi{k + 1) = 
fi(X{k)), where /j is a suitable function determined by S. Then J{X) is the absolute 
value of the determinant of the matrix {dfi/dXj)^. 
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with the initial condition of the reversed trajectory, time reversibihty I yields: 
A(X) = -A(/X), wixr = wx\ and = exp(r(A)p) (5.21) 

if er{X) = p. Taking small e in -Bp,^, the division of each term in the numerator 
of (5.20) by its counterpart in the denominator approximately equals e'^^^'^'^, 
which then equals the ratio in (5.20). In the limit of small e, infinitely fine 
Markov partition and large r one obtains: 



Theorem (Gallavotti-Cohen). Let {Ai,S) be dissipative (i.e. (A) > 0), re- 
versible and assume that the Chaotic Hypothesis holds. Then, 

T^ABp^e) _ t(A)p 



e^'^'^'P . (5.22) 



with an error in the argument of the exponential which can be estimated to be 
p, T independent. 



If the A-FR (hence the Chaotic Hypothesis on which it is based) holds, the 
function C{p; r, e) = (l/r(A)) log [7iT-{Bp^^) /71t-{B_p^^)], tends to a straight line 
of slope 1 for growing r, apart from small errors. If A can be identified with a 
physical observable, the A-FR is a statement on the physics of nonequilibrium 
systems. 

Under the assumption that A coincides with the entropy production rate, 
the A-FR can be used to obtain the Green-Kubo relations and the Onsager 
reciprocal relations, in the limit of small external drivings [187]. This way, the 
A-FR appears to be an extension of such relations to nonequilibrium systems. 
Gallavotti assumes that the (Gaussian isokinetic, continuous time) system is 
driven by the i fields F = {Fi, F2, Fe), that the phase space contraction 
rate vanishes when all drivings vanish, and that 

A(X) = ^F,J°(X) + 0(F2). (5.23) 

i=l 

This relation defines the linear "currents" J°, which are proportional to the 
forces Fj. Then, the fast decay of the A- autocorrelation function, leads to this 
expansion for the large deviation functional 




(5.24) 



Time reversibility means: IS"" = S where P =Identity. For instance, / is the 
reversal of momenta for Eqs.(5.11), but is more complicated for the shearing system 
of Ref.[148]. 
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where 



/oo 
{A{S'X)A{X))c dt 
-oo 



and (.)c denotes the cumulant. Thus, the A-FR, Eq.(5.22), leads to (A) = 
C2/2 + 0(F3). Now, let the full (nonhnear) "currents" be defined by Ji{X) = 
5i?;A(X), and the transport coefficients be Lij = dp^{Ji)\p=Q. The derivatives 
with respect to the parameters F require a property of differentiability of SRB 
measures, which has been proven by Ruelle [188]. Assuming this property, the 
validity of the A-FR and time reversibility, one can write 

(A) = ^ E {dpM) + ^FAJJ))\F=oF^F, = 1 E iL^, + L,,)F,F, (5.25) 

to second order in the forces. Then, equating this with C2/2 and considering 
{Lij + Lji)/2 with i — j, one recovers the Green-Kubo relations. To obtain 
the symmetry L^j — Lji, Gallavotti extends the A-FR to consider the joint 
distribution of A and its derivatives. He introduces the dimensionless current 
q, averaged over a long time r, through the relation 



- FjdpA{S'X)dt = Fj{dp.A)q{X) (5.26) 

T J—t/2 



and considers the joint distribution TTr{p,q), with corresponding large devia- 
tion functional C{p, q) = — hm^-^oo 7 log7r^(p, q). The result is a relation similar 
to the A-FR: 

lim-i-log^t(ML = l. (5.27) 

r^oo t{A)P T^t{—P, —q) 

This makes the difference {C{p,q) — C{—p, —q)) independent of q, which leads 
to the desired result, L^j = Lji, in the limit of small F. This work was refined 
in [189]; for related results, based on orbital measures, see Refs. [190,191]. 

Assuming that the currents and transport coefficients, here defined in terms 
of the phase space contraction rate, do represent physical quantities, these 
results show that the FRs are consistent with Irreversible Thermodynamics, 
close to equilibrium. Hence they may be considered in the construction of 
a comprehensive nonequilibrium theory. However, some difficulties affect the 
present approach; the first being that A, which is directly related to the ther- 
mostatting term Oth, only in very special cases results proportional to the 
energy dissipation rate divided by the kinetic energy, fl. 

Because global fiuctuations are not observable in macroscopic systems, local 
fluctuation relations have been devised, see e.g. Refs. [192,193,194], and in [183] 
also a local version the A-FR was tested numerically. In particular, the local A- 
FR of Ref.[194] concerns an infinite chain of weakly interacting chaotic maps. 
Let Vq be a finite region of the chain centered at the origin, Tq > be a time 
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interval, and define 



1 To-l -, To/2 

(A)= lim TTTyfT Envois' X), P=7vr^ E Av,{S^X) , (5.28) 

where F = x Tq, Ayg(X) is the contribution to A given by Vq, and \E\ 
denotes the volume of the set E. Then, one obtains: 

7r^(p) = e^(^)l^l+^(l^^l) , with ^^^^ - 1 andb|<p*, (5.29) 

where is the size of the boundary of V, p* > 1 and C is analytic in p. 
The contribution of the boundary term \dV\ should decrease with growing V, 
leading to the A-FR in the limit of large (compared to microscopic scales) 
volume Vo and long times T. 

The problem of local fluctuations, naturally leads to the possibility of extend- 
ing Onsagcr-Machlup theory to nonequilibrium systems. This has been done 
by Gallavotti [195,196], under the assumption that the entropy production 
rate is proportional to A. 

The fact that A ^ Q in general, and the identiflcation of the systems of phys- 
ical interest which verify the Chaotic Hypothesis, hence the A-FR, pose an 
interesting question. For instance, Ref.[150] assumed that the A-FR could ap- 
ply to systems which have singular A, since the A-FR had been proposed and 
verified in one such system [148] . Later, however, the steady state A-FR was 
found to be hard, if not impossible, to verify in non-isoenergetic systems with 
singular A, close to equilibrium [156,197,198]. In [161] various scenarios are 
proposed to explain these facts. One of them concerns Gaussian isokinetic 
systems, whose A is the sum of a dissipative term and a conservative term, 
and may be singular because of the interaction potentials (cf. Eqs.(5.12,5.14)). 
In that case, the dissipative term Q obeys the FR, while the conservative term 
does not, but its averages over long time intervals should become negligible 
with respect to the averages of fl as the length of the intervals grow [198,161]. 
Thus, in the long time limit, the A-FR should hold as a consequence of the 
validity of the Q-FR, while the convergence times of the A-FR would diverge 
when equilibrium is approached, because fl vanishes as the square of the driv- 
ing forces. Moreover, for reasons of symmetry, the range [—p*,p*] of validity 
of the A-FR must shrink to {0} when the driving fields vanish, so that the 
A-FR may hold but only for trivial fiuctuations. 

Trying to understand these facts, Rcfs. [161,199,162] concluded that in some 
cases A describes heat fluxes, not entropy productions, hence that in those 
cases the A-FR has to be modifled, to mimic the heat FR of Van Zon and 
Cohen for stochastic systems [200]. In particular, Ref.[162] considers systems 
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of the following form 

^qi = P^ ^p. = ^-9q^$-ap, A = A(°)-/?^l^ (5.30) 

where V is related to the interaction potential]^ assuming that they have an 
equilibrium {E = 0) distribution with exponentially decaying tails, while A^°) 
has Gaussian tails. It is then assumed that the tails have the same properties 
when E ^ 0. Then, the average of A in a time r takes the form 

Ao,.(X) = - r k{S'X)dt = AW (X) + ^ \V{S^X) - V{X)] . (5.31) 
r JO T 

For chaotic systems, and large r, it is now reasonable to assume that A'^''^ 
Vf{X) = V{S^X) and Vi{X) = V{X) are independently distributed. This, 
together with the exponential tails of V , leads to 

1 1 /•P*(A> 



hm -logM(p*) = hm - log T dA(o)e-Co(A(«))-r|A-A(°)| 33) 

T^oo 7- r^oo 1 J-p*(A) 



/-p*(A> 



where 



rfAW / dV^ / rfr.e^^°(^"")-^(^^+^/)(5[r(A-A(°))+/5(r-V,)] 

-p*(A) JO JO 

(5.33) 

and Co(A^°'') is the rate (Cramer) function of A^^\ Then, one obtains 



((A) = max 

A(0)GhP*(A),P*(A>] 



(^g(A(o))-|A-A(°)| 



Co(A_)-A_+A, A<A_ 

Co(A) , A_ < A < A+ (5.34) 

Co(A+) + A+-A, A>A+ 



where Co(A±) = ^1- If the FR holds for A(°), with |A(°)| < p*{A), the fact that 
(o((A)) = leads to 



A 



|A| < (A) 



C(A) - C(-A) = 



Co(A) + A, (A)<|A|<A+ 
Co(A+) + A+ , |A| > A+ . 



(5.35) 
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For instance, in the Gaussian IK case of Eqs.(5.12,5.14), one has 

N 



df 2K ^ m' ' 

■ =1 
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A relation similar to the heat FR of Van Zon and Cohen of [200] is thus 
obtained for A. The authors of [162] conclude that the A'^^^-FR holds with 
\p\ < P* 1 if A*^*^) is bounded or decays faster than exponential. They adopt 
Gentile's approach for Anosov flows, which reduces the flow to a Poincare 
map [184], and assume that the Chaotic Hypothesis apply to a Poincare map 
which avoids the singularities of A. This may be done taking a level section 
V = V, for a certain value V. Then, the volume contraction rate of the map, 
A^^\ is bounded, the terms (V/ — Vj) vanish, because Vi = Vf = V, and the 
Chaotic Hypothesis yields the A'^'^^-FR. Here, the connection with the Van Zon 
- Cohen theory is made replacing the white noise with chaos due to uniform 
hyperbolicity. 



5.4-2 The Evans- Searles approach 

Because A has no obvious physical meaning and the A-FR is based on strong 
assumptions which are not strictly enjoyed by systems of physical interest, one 
natural question comes to the fore: can one derive the steady state relation 
for the dissipated power divided by the kinetic energy, the r2-FR, under more 
physical assumptions? In [201], the Evans-Searles approach, first proposed in 
1994 [202], has been pohshed to give an affirmative answer to this question. 

Let us begin with the transient r2-FR. Let M. be the phase space, S'^ : M. ^ 
Ai, a reversible evolution with time reversal involution operation /. Take a 
probability measure diJ,{T) = f{T)dr on M., and let the observable cf) : M. ^ 
IR be odd with respect to time reversal (i.e. 0(/r) = — 0(r)). Introduce 



Kto+ri^) = - / " ^ <l>{S^r)ds = -0to,to+r(r) (5.36) 

T JtQ T 

and the Dissipation Function 



Q,,,„+.(r) = i In + Ato,to+r(r) (5.37) 

for time even probability density / (i.e. f{IT) = /(F)). The derivation that 
follows holds in full generality, but Q equals the dissipated power only if / is the 
equilibrium probability density for the given system, or is properly related to 
that. The existence of the logarithmic term of Eq.(5.37) has been called ergodic 
consistency [151]. For 5 > 0, let = {A-5, and Aj = {-A-5, -A+5), 

and let i?(0 G {a,b)) be the set of points F such that 0(F) G {a,b). Then, 
E{Uo,r e Aj) = IS^E{no^^ e Aj), and the transformation F = IS^X has 
Jacobian 

^ = e-^°--(^) , (5.38) 



dT 




dX 


= exp ( 
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which leads to 



lEiTlo,.eAj) fWX lEin,,^^At) exp [-Jlo,.(^)] f{X)dX 
i.e. to the transient Q-FR: 



(5.39) 



li{E{no,r e Aj)) ' " - ^ ^ 

which concerns the non-invariant probabihty measure fi of density /. Time 
reversibihty is essentially the only ingredient of the above derivation. 



To obtain the steady state Q-FR, consider the ratio 

(5.41) 



/^(^(0to,*o+r e Aj)) _ lEa^^^^^^^^Ai)fi^)dr 



i^{E{<p,,,,^^ e AJ)) lEi^,^,^,^eAj)mdr 
and take t — 2to + T. Then 

E{Kto+r e AJ) = IS'E{4>,^,^^, e At) (5.42) 
so that the transformation F — IS^W , and the same algebra as above, yield 

Move now the evolution from sets to measures, using 

li{E) = iit^iS'^E) = / ft,{W)dW (5.44) 

where is a subset of M., fj^to is the evolved measure up to time to, and ftQ 
its density. Some algebra yields 



/x,„(E(0o,, G Aj)) _ /x,,(5^°E(0,„,„^, e Aj)) 
l,to{E{<Po,r ^ AJ)) ^,,{S^^E{<P,^,^^^ e AJ)) 

_/^Wto,*o+reA+)) _ 1 



. (5.46) 



Wc call 0-FR this relation. For ^^^^ = taking the logarithm and 

dividing by r, it produces: 



l^^^ /i,,(i^(go,.e A+)) 

r /^io(^(Oo,r e A")) 

A + e(5, to, ^, r) - - In /e-*o(^o.'o+%+-.2*o+-)\_ ^(5.47) 
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If tends to a steady state /ioo when to oo, the above should change from 
a statement on the ensemble , to a statement concerning also the statistics 
generated by a single typical trajectory. A result like this would be the steady 
state Q-FR. This requires further assumptions, because to tends to infinity 
before r does and, in principle, the growth of to could make the conditional 
average in (5.47) diverge. Nevertheless, the decay of the auto-correlation of Q 
suffices. Indeed, the conservation of probability yields 

(e"^^°'^) = 1 , for every seM, (5.48) 

and if the ^-autocorrelation time vanishes, one can write: 



^g-to(no,t(,+f^to+T,2to+T)^ _ ^g-toQo.to^ ^g-*of2to+T,2to+T^ (5.49) 

and 

/ sno,s-{t-s)-nsA ^ /g-^^o.A U-^sA ^ A-(t-s)ns,t\ ^ ^ _ 



(5.50) 

Hence, the logarithmic correction term in (5.47) identically vanishes for all 

to, T, and the f2-FR is verified even at short r's. Of com^sc. this idealized situ- 
ation does not need to be realized. Nevertheless, tests performed on molecular 
dynamics systems indicate that there exists a constant K, such that [201,203] 

< — < /e-*o(^0'«o+f^*o+-.2*o+-)\_ ^<K . (5.51) 

As a matter of fact, the decorrelation (or Maxwell time), tui expresses a 
physical property of the system, thus it does not depend on to or r, and 
depends only mildly on the external field [usually, tuiPe) = ^m(O) + 0{F^)]. 
Its order of magnitude is that of the mean free times. If these scenarios are 
reahzed, Eq.(5.51) follows and the logarithmic correction term of Eq.(5.47) 
vanishes as l/r, with a characteristic scale of order 0{tM)- 

It results that the steady state fi-FR can be obtained basically only from time 
reversibility and from the decay of the Q-autocorrelation, and one can write 

1 ^ioo{E{Qo.r e Aj)) ^ ^ ^^^^^ correction (5.52) 

where the small correction can be made arbitrarily small taking sufficiently 
large r and sufficiently small 5. This decay of correlations could be relaxed or 
replaced by other assumptions, but is needed for the convergence to a steady 
state, and is verified in most systems of physical interest. Furthermore, this 
approach explains why the relevant convergence times are functions of material 
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properties of the systems, and do not diverge in the equihbrium hmit. The 
decorrelation times of fl are indeed material properties. 



Various other relations can now be obtained. For instance, for any odd (f), any 
S > 0, any to and any r, one has 

(exp {-tno,t) = 1 (5.53) 

which, in the S ^ oo hmit, leads to the weh known normalization property - 
the so-called Nonequilibrium Partition Identity (5.48). Given a second density 
/ and the corresponding Cl, one has 



(5.54) 

for large to, all r and all allowed pairs A and — A, if d/x = fdT and dfl = fdT 
converge to the same steady state. Then, as far as the FRs are concerned, the 
different dissipation functions are equivalent. The Dissipation Relation 

(0)i= f ds{Q{0)<P{s)) , (5.55) 
Jo 

where {.)t the average with respect to iit, is another direct consequence of the 
approach followed in this section [204]. 

The theory outlined above is consistent with Irreversible Thermodynamics, 
since it leads to the Green-Kubo relations, close to equihbrium [161]; hence it 
can be considered in the construction of a more general theory, which encom- 
passes far from equilibrium phenomena. Differently from Ref.[187], which deals 
with A and with asymptotic times, Rcf.[161] deals with Q and stresses the role 
of the physical time scales. This is illustrated on a Nose- Hoover thermostatted 
system [Eqs.(5.16)], whose equilibrium state is given by the extended canonical 
density 

where Ho is the internal energy, Kq si the reference kinetic energy corre- 
sponding to the inverse temperature f3, and g depends on the number of de- 
grees of freedom [17]. In the most common case, in which F^^* = CjFg and 
J = Eili Ci{dqi/dt), one has 



dt 



2K 

and 

A = -div [::-]-d.[^\=dm, 
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where d is the spatial dimension, which shows that A and its fluctuations are 
not directly related to the dissipation rate Q = ■ F^V, while its average is, 
because (Hq) = 0. Integrating fc{x, ^) yields 



27r 



exp 



(5.57) 



Therefore, the distribution of ,^q^ is also Gaussian in equilibrium, with vari- 
ance proportional to that of /io,t = (1/^) loHodr, and near equilibrium it 
can be assumed to remain Gaussian, around its mean, for large t, as a con- 
sequence of the Gentral Limit Theorem (GLT). To use the A-FR together 
with the GLT, the values A and —A of the random variable ^ot must be a 
small number of standard deviations away from (Q). However, as explained 
in Refs.[198,161,162] and briefly recalled in Section 5.4.1, the distribution of 
dN^Q^^ verifies the A-FR only for times t sufficiently large that the standard 
deviation of the random variable /io,t is negligible with respect to that of Qo,t) 



^Ho,, say. 



In [156] it was proven that the variance of the average current obeys 



H.(^e) 



2L{Fe)k,T (Fr 
V UN. 



(5.58) 



hence that of VLq t obeys 



<,(^e) 



2Ko 



2L{F,)k,T (Fr 
V ^ UN, 



(5.59) 



L(F,) = / dt{{J{t) - (J))(J(0) - (J))) 



where 



and L(0) = lim^g^o -^(-^e) is the corresponding linear transport coefficient. 
Equation (5.58) shows that the standard deviation of the average current 
decreases when t grows at fixed Fg, while it tends to a positive constant, when 
Fe decreases at fixed t. Gonsequently, the standard deviation of Qo,t tends to 
zero when Fe — > at fixed t. Differently, the variance of /io,t tends to a constant 
when Fe tends to zero at fixed t. Therefore, the smaller Fg the longer the time 
t needed for to dominate over the variance of /iq,*, and this time grows 
without bounds when F^ tends to zero. Let us assume for simplicity, that 
the variations of these standard deviations are monotonic when either Fg or t 
varies and the other variable is fixed. Then, given Fg and A, there is t„{Ff,, A) 
such that the standard deviation of Ao,f is sufficiently large that A and —A 
are within a few standard deviations from the mean only if t < t„{Fg, A). At 
the same time, let ts{Fe,A) be sufficiently large that the steady state A-FR 
applies to the values A and —A, with accuracy 6. To derive the Green-Kubo 
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relations from the A-FR, one would need 

ts{F„A) <t<t,{F„A) (5.60) 

which is not satisfied if ts{Fe, A) grows too fast with decreasing F^,. This sug- 
gests that the derivation of the Green-Kubo relation from the A-FR is prob- 
lematic, for systems like the Nose-Hoover systems or the Gaussian isokinetic 
systems with singular interaction potentials. In Ref.[161] it is further shown 
that the validity of Eq.(5.60) is necessary but not sufficient to obtain the 
result. 



Differently, there is no problem in obtaining the Green-Kubo relation from the 
f2-FR , because the corresponding convergence times do not diverge when F^ 
tends to zero (as seen above, they become of the order of the Maxwell times), 
and because Q is the observable of interest (the energy dissipation rate divided 
by the kinetic energy). For times t of the order of the Maxwell time, one may 
then write [161]: 

(l]) = -4^^ or m=Yim^y- = (3V ds{J{Q)J{s)) (5.61) 

where the first equality is due to the validity of the f2-FR and the second to 
(5.59) 
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5.4.3 The Jarzynski and the Crooks relations 

A transient relation for the fiuctuations of non-dissipative systems has been 



obtained by Jarzynski [163]!^ To introduce this relation, the author consid- 
ers a Hamiltonian finite particles system, in equilibrium with a heat bath at 
temperature T, which is driven away from equilibrium, by performing some 
work 14^ on it. If A is a parameter that controls the Hamiltonian Hx say, the 
work is performed varying A. Let A = A(t) be a given protocol of duration 
r for a variation of A from a value A(0) = A to another value A(r) = B. 
Suppose that the same protocol is repeated many times, always in the same 
manner, and always from the equilibrium corresponding to X = A, to build 
the statistics of the work done when A evolves from A to B. Let p be the PDF 
of the externally performed work and {e~^^)A->B the average over all works 
done in varying A from AtoB. These works are not the thermodynamic work 
done on the system, if the process is not performed quasi-statically, in the 
presence of local equilibrium [205] , but is nevertheless a measurable quantity. 



^9 Equating Eqs. (33,34) in Ref.[161], one obtains pVFe = {J)/ta^^^. Then, the fact 
that n = pVFeJ implies PVF^ = 2{n) /taj^ ^l3VFe, from which Eq.(5.61) follows. 
'^^ The non-invariant ensemble, which characterizes the "transient" nature of the 
Jarzynski equality, is the initial canonical ensemble. 
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The Jarzynski equality states that [163]: 



where /3 = l/k^T, and [-P'(-B) — -^(^)] is the free energy difference between 
the initial equilibrium, with \ — A and the equilibrium state corresponding 
to A = 5. This state exists and is unique, hence the value of the state variable 
F at A = S is well defined, but it does not need to be the actual state of the 
system at time r. Indeed, the work W is performed on the system in the time 
interval [0, r], while relaxation to the equilibrium corresponding to A = i? may 
require longer times, depending on the explicit form of the protocol \{t). Note 
that the process always begins in the same equilibrium state corresponding to 
A = A, but in different microscopic states. In general, at time r, the system 
will not even be in local equilibrium: Eq.(5.62) is supposed to hold for all 
possible protocols, hence even arbitrarily far from equilibrium (large ^A). 
Therefore, the presence of the equilibrium quantities F{A) and F{B) may 
look puzzling. The puzzle is solved observing that the externally measured 
work docs not need to coincide with the thermodynamic work (which would 
not differ from experiment to experiment, if performed quasi-statically, cf. 
Section 5.4.4). From an operational point of view, it docs not matter whether 
the system is in local equilibrium or not: the externally applied forces can 
be measured, the resulting motions can be recorded, hence the externally 
performed works arc defined and can be quantified. The difference of this 
process from a standard thermodynamic one is that the external work cannot 
be equated to the internal thermodynamic work, if the process is not performed 
quasi-statically. 

The limitation of Jarzynski's derivation, that the dynamics be Hamiltonian, 
has been overcome by Evans in terms of NEMD models [206]. Therefore, 
the Jarzynsky equality, similarly to the transient r2-FR, results of quite wide 
applicability, since it does not rest on particular conditions on the microscopic 
dynamics. It is also consistent with the second law of thermodynamics, since 
it yields 

m)A^B>P[nB)-F{A)] (5.63) 

because In ($) > (ln<l>) for positive observables although is not a 

thermodynamic quantity in general. 

Similarly, computing the ratio of the probability that the work done in the 
forward transformation is W , to the probability that it is —W in the B to 
A transformation, with reversed protocol — ^A, produces the Crooks relation 
[207]: 

^roh a^b{W = a) ^ ^_p^F^B)-F{A)] ga g4^ 

which leads to the Jarzynsky equality, by a simple integration: 
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j PmhA^BiW = a)e-''da = e-/3[-^(-B)-P(^)] j FrohB^AiW = -a)da 

A relation exists between these results and the Q-FR. In the first place, the 
transient Q-FR may be applied to the protocols of the Jarzynski equality and 
of the Crooks relation, [199]. Then, let Ja and fs be the canonical distributions 
at same inverse temperature (3, for the Hamiltonians Ha and Hb- The cor- 
responding Helmholtz free energies are Fj = — fc^Tln/ dqdpexp[—Hi/kgT] 
ior i — A,B. For simplicity, let A go from A to B in a, time r, with rate 
= l/r, and from B to A with rate J^A = — I/t- Correspondingly, the 
microscopic thermostatted evolution equations are 



d dHx{ci,p) d dHx{ci,p) 

d^^=^^' dt^^ ^'-''^ 

4a = ±- , with + for A ^ S and - for S ^ A (5.67) 
dt T 

where = 1 for i = 1, ...A^«, and = for i > N^, so that the deterministic 
thermostat acts only on the A^^ particles of the walls of the system, to fix 
their kinetic temperature and mimic a heat bath at temperature T. Then, the 
work performed by the external forces is given hy (3W = (3[Hb — Ha] — Aq,,-- 

U A = B, the i7-FR applies directly, and the Jarzynski equality is an imme- 
diate consequence of the f]-FR because the 0-FR implies 



J P{W)e'^^dW = J dWP{-W) = 1 . (5.68) 



The transient fi-FR, the Jarzynski equality and the Crooks relation do not 
have the same range of applicability, the Crooks relation being the most gen- 
eral. It is remarkable how all of them connect equilibrium to nonequilibrium 
properties of physical systems: the transient Q-FR deals with the energy dis- 
sipation associated with the application of a dissipative field to an ensemble 
of systems initially in equilibrium; the Jarzynski and Crooks relations relate 
the work done to the free energy differences. The point of view of NEMD is 
important in this context, because finite Hamiltonian systems do not afford 
nonequilibrium steady states and also because, in general, external drivings 
do not need to preserve the Hamiltonian nature of the dynamics. Therefore, 
the agreement, where appropriate, with the NEMD approach strengthens the 
results. The interest of all these relations is bound to grow with our under- 
standing of microscopic systems, particularly in biophysics and nanotechnol- 

ogy- 
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The connection between equilibrium and noncquilibrium properties made by 
the f2-FR, the Jarzynski equahty and the Crooks relation is, in a sense, op- 
posite to that made by the Fluctuation Response formula: while the relations 
treated in this subsection obtain information about equilibrium states from 
nonequilibrium dynamics, the Fluctuation Response formula uses equilibrium 
fluctuations to gain information on nonequilibrium states. 

5.4-4 Ensemble vs thermodynamic relations 

There is a substantial difference between the transient relations considered in 
this Section (see also, e.g. [208]), and the Fluctuation Response formula. The 
Fluctuation Response formula concerns thermodynamic properties of macro- 
scopic objects, hence it holds for the behaviour of a single system. Differently, 
as previously observed, the transient relations concern the statistics of ensem- 
bles of objects. Nevertheless, the transient relations are sometimes confused 
for thermodynamic statements. This is due to the fact that the transient rela- 
tions either have forms similar to the second law of thermodynamics, or can be 
used to obtain relations formally like the second law. Also, the statistical na- 
ture of the results concerning a collection of particle systems, is often confused 
for the statistics concerning the many particles of a single system. Obviously, 
this is not appropriate, and the importance of the transient relations must be 
found precisely in their unavoidable ensemble nature, not in their thermody- 
namic content. Indeed, the differences between the two kinds of relations have 
practical consequences, which can be understood as follows: 

1. Thermodynamic statements do not refer to ensembles of systems, they con- 
cern single systems. If one has a collection of systems in the same ther- 
modynamic state, they all behave in the same way, hence their average 
behaviour is, a fortiori, bound to be that of a single member of the collec- 
tion. For this reason, one may resort to a microscopic statistical description, 
in which each single system is in a different microscopic state, in order to 
recover the unique common thermodynamic behaviour. This macroscopic 
behaviour emerges when the time and space scales are well separated from 
the microscopic scales, and sufficiently mixing processes take place. In that 
case, the differences among the ensemble members are not observable: they 
cannot be expressed in terms of thermodynamic quantities, such as the ther- 
modynamic work W done on a system. Equivalently, one may say that the 
differences vanish typically as 1/ \/N, where N is the number of particles of 
each system in the collection. Thus, sufficiently large N implies practically 
no differences in the behaviours of the collection members. 

2. If work is done in a reversible fashion on a macroscopic system, one can 
draw the corresponding path of thermodynamic states in the, e.g. pressure- 
volume plane. Integrating along this path, one obtains a given value for the 
work done on the system, which is operationally accessible, by measuring 
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the work done by the external equipment. In this case, the system and the 
working apparatus are globally in close contact all the time, and the energy 
given to the system, under a fixed protocol, is always the same. Therefore, 
the ensemble average and the single works are equal, and equal the internal 
and the external works. 
3. If work is not done in a reversible fashion, one obtains different values for 
W, even if the same protocol is repeated. The energy that a single system 
may acquire from the experimental apparatus cannot be predicted, and 
only averages over many repetitions of the protocol may be inferred. The 
transient relations serve to this purpose. It is interesting to observe that 
this is the case even for large A^. Indeed, given a large collection of systems, 
the different values of the works performed on them (not to be confused 
with fiuctuations in the evolution of a single system) are not due to the size 
of N, but to the fact that the process is not quasi-static, and corresponds 
to no path in the space of thermodynamic states. The reason is that the 
energy exchanged between system and driving apparatus depends on the 
microscopic initial state, not just on the driving protocol. Every time the 
protocol is repeated, the microstate is different, hence a different value for 
W is obtained. This value is unpredictable, because the initial microstate is 
unknown, moreover different initial ensembles lead to different statistics. 

Therefore, the content of the ensemble relations in far from equilibrium pro- 
cesses is not, e.g. the impossible quantification of the dissipative works, but 
the statistical description of large collections of systems. Indeed, they describe 
intriguing properties of the chosen initial ensembles. The fact that only in cer- 
tain limits are the transient relations equivalent to thermodynamic statements 
is not a difficulty, because they have the advantage of being valid even when 
the thermodynamic description fails (e.g. in the absence of local equilibrium, 
or for systems of a small number of particles). 



6 Fluctuation relations in stochastic systems and applications 



6.1 Stochastic systems: bounded and unbounded state spaces 



The derivations of the FR for stochastic systems are much easier than those 
of the A-FR, because, as noted in [209], the difficulties connected with sin- 
gular invariant phase space distributions are avoided, and one can deal with 



smooth probability distributions. [i_J The first of the stochastic FRs was pro- 



Note that for the same reason the derivation of the J7-FR given in Section 5, 
which deals with the evolution of probabihty densities, is technically much easier, 
and of wider applicability than that of the A-FR. 
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duced by Kurchan, who obtained a modified detailed balance property for 
Langevin processes of finite systems, and a FR for the entropy production, 
under a few assumptions, like e.g. the boundedness of the potential [164]. 
Lebowitz and Spohn [210] extended this result to generic Markov processes 
with a finite number of states. Additionally, under the assumption that local 
detailed balance is attained, they showed that the Gibbs entropy production 
is related to the action functional that satisfies the FR. This means that for 
Markov processes the Gibbs entropy production plays the role of the phase 
space contraction rate in the A-FR. Maes obtained a large deviation principle 
for discrete space-time Gibbs measures [211]. He showed that using the Gibbs 
formalism to describe the steady state of time discrete lattice systems leads to 
a FR for a kind of Gibbs entropy production. These results can be seen as a 
generalization of the A-FR and of its stochastic versions, as stochastic dynam- 
ics and thermostatted systems satisfying the chaotic hypothesis are particular 
cases of space-time Gibbs measures. 

Farago pointed out that singularities may cause difficulties in the conventional 
use of the FR, for stochastic systems [212]. Wang, et ai, reported the experi- 
ment of a colloidal particle that is dragged through water by means a moving 
optical trap [213], confirming an integrated version of the transient FR. This 
experiment may be modeled through a stochastic Langevin evolution describ- 
ing a Brownian particle, dragged in a liquid by a moving harmonic potential, a 
problem studied by various authors [212,214,215,216]. In particular, analyzing 
the results of [213], Van Zon and Cohen [200] observed that, in the presence 
of a potential term, the work done on the system in a time r, W^, consists of 
two parts: the heat Qr corresponding to the energy dissipated in the liquid, 
and the potential energy difference of the Brownian particle AUr'- 



A Brownian particle in a fiuid, subjected to a harmonic potential that moves 
with a constant velocity v*, is described by the overdamped Langevin process 



where x{t) is the position of the particle at time t, x*{t) = v*t is the prescribed 
position of the minimum of the potential and ({t) is a white noise term rep- 
resenting the fluctuating force the fluid exerts on the particle. The units used 
are such that /c^T = 1. The total work is given by 



In a comoving frame Eq. (6.2) reduces to a standard Ornstein-Uhlenbeck pro- 
cess and thus, the stationary probability distribution and Green's function 
are Gaussian in the particle's position. Since the total work is linear in the 



Wr^Qr + AUr ■ 



(6.1) 



dx{t) 
dt 



[x{t)-x*{t)]+at) , 



(6.2) 




(6.3) 
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particle's position, Wr is Gaussian as well. Because of this and of Eq. (6.3), 
in the case of transient fluctuations, the variance of Wr equals 2{Wr). Since 
Wr is Gaussian, the total work satisfies the transient FR. In the r — > oo limit, 
the variance of Wr remains twice its mean, hence the total work satisfies the 
steady state FR. 

Van Zon and Gohen pointed out that the quantity measured in the experiment 
of [213] was precisely the total work and thus, in agreement with their Langevin 
treatment. However, they also clarified that, while the PDF of the total work 
is Gaussian, at equilibrium the PDF of the potential energy is exponential: 
P{AU) ~ exp(— const. AU), and is expected to remain such in the steady 
states. Therefore, while the small fluctuations of heat are expected to coincide 
with those of the total work, since the contribution of the potential energy 
is only 0(1), large heat fluctuations are more likely to be due to a large 
fiuctuation of the potential energy. 

Consider the harmonic potential U(t) = ^\x(t) — x*(t)\'^ in Eq. (6.1). The 
heat Qr is nonlinear in the particle's position, hence its PDF needs not be 
Gaussian. Gompute the Fourier transform of this PDF: 

Pr(q) = / dQre^i'^-ProhriQr) ■ (6.4) 

Writing ProhriQr) in terms of the joint distribution of the work Wr and of 
the positions x{0),x{t), one obtains 

p _ exp{^(^-g) (r- i^.t-^'O ) .^ 

where w — {Wr)/T is the rate of work done in the system, related to the 
stationary state average. Anti-transforming Pr{q), one considers the heat fiuc- 
tuation function 



A(p) = — In 

WT 



'Piohripwr) 



(6 6) 

Vl oh r{—pWT) ' 

where p = Qr/iQr) and (Qr) = {Wr) - (Af/^) = wr, since {AUr) = 0, in 
the steady state. To obtain an asymptotic analytical expression of Eq. (6.6), 
consider the quantity 

e(A) = lim — -le-^'^^) , (6.7) 

T^oo WT 

for large r, and 

Prob^(Q^) ~ e-"'^^('?-/"'^) , (6.8) 
where e(p) = max{A} [e(A) — Ap] is the Legendre transform of e(A). Analytically 
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continuing to imaginary arguments, one can write (e ^'^'^) — PT-{iX), i.e. 

_ exp[-^A(l-A){r+ ff(^-7)^. }] 
^ [1 _ (1 _ e-2r)A2]3/2 ' ^o.y; 

which is singular for A = ±(1 — e"^"^)"^/^. Using Eqs. (6.7) and (6.9) and 
taking the r — > oo limit, the singularities move to ±1, yielding 

e(A) = A(l - A) for |A| < 1 . (6.10) 

This imphes that the conventional steady state FR, limT-^oo frip) = P, holds 
as in Ref.[210]. Outside the interval (—1, 1), the integral in Eq. (6.8) diverges 
due to the exponential tails of the PDF of Qr'- e(A) = — oo for |A| > 1. 
Finally, taking these values in the Legendre transform e{p), and substituting 
in Eq. (6.8) one obtains 

<p < 1 

l<p<3 (6.11) 
P > 3 

and the values for negative p are obtained from /t(— p) = —frip)- The fluctu- 
ations of heat that are smaller than (Qr) satisfy the conventional FR, as those 
of Wr', larger heat fluctuations behave differently, in particular, the probability 
ratio fr is much larger than that predicted by the conventional FR. A similar 
phenomenon can occur in deterministic systems [161,162], and the logarithmic 
term in the definition of Q, Eq.(5.37), represents the corresponding boundary 
terms. 

The vahdity of the extended FR of Van Zon and Cohen has been addressed 
in other stochastic systems. For instance, Ref.[217], where a granular system 
is also considered, studies the extended FR, and shows that the boundary 
terms may be important in many common situations. One interesting feature 
of the models considered in [217], is that the granular system behaves very 
similarly to a simple Markov chain with unbounded state space, as discussed 
in Subsection 5.4.1. Somewhat different results are reported in Ref.[218], which 
shows that the extended FR does not hold in the partially asymmetric zero- 
range process with open boundaries. Hence the range of validity of the Van 
Zon - Cohen scenario is still to be fully understood. 

Various other studies have dealt with the problem of a Brownian particle and 

Langevin process in general, like those of Refs. [219,220,221,222,209,223,224,225] 
In particular, Ref. [223] points out that exponential distributions of the bound- 
ary terms may not always have the same effect on FRs, hence the problem of 
their relevance in FR remains open. 



P 



p-(p-l)V4 



for 
for 
for 
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Relation 


State 


Dynamics 


Observable 


(5.1) 


NESS 


Gaussian thermostatted 


DP 


(5.22) 


NESS 


Reversible transitive Anosov 


A 


(5.29) 


NESS 


Reversible transitive Anosov 


Local-A 


(5.35) 


NESS 


Reversible flow with transitive 
Anosov Poincare map 


Local-A 


(5.39) 


SMe-NE 


Reversible and dissipative 


fl 


(5.43) 


SMe-NE 


Reversible and dissipative 




(5.48) 


SMe-NE 


Reversible and dissipative 


n 


(5.55) 


SMe-NE 


Reversible and dissipative 


Q 


(5.52) 


NESS 


Reversible and dissipative 
^-correlation decay with 

respect to initial measure 


n 


(5.62) 


C-NE 


Hamiltonian dynamics 


F 


(5.64) 


C-NE 


Hamiltonian dynamics 
or Markov process 


F 


(6.11) 


NESS 


Markovian model of 
colloidal particle in optical trap 


HF 



Table 1. Synoptic table of fluctuation relations. The first column gives the equation 
number. The second column gives the details of the state for which the relation 
holds: NESS means nonequilibrium steady state, C-NE means experiments starting 
in canonical equilibrium and continuing under nonequilibrium dynamics, SMe-NE 
means initial smooth ensemble followed by nonequilibrium dynamics. The third 
column specifies the dynamics for which the relation has been obtained. In the fourth 
column, the observables for which the relation holds are given: DP means dissipated 
power, A means phase space contraction rate, $7 means dissipation function, (p is 
any odd observable, F is the Helmholtz free energy. Local means integrated over a 
given region of the relevant space, HF means heat fiux. 



6.1.1 Markov chains with an infinite number of states 

The problem of singularities in unbounded spaces can be understood in detail 
using a simple model [226,217]. Consider a Markov chain with N (possibly 
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infinite) states with invariant probability measure fj, = {fJ^a} and transition 
rates Kah which denote the conditional probability of going from state a to 
state b. We are interested in the fluctuations of the following two "action 
functionals" : 

W{t) =j2^og^^ (6.12a) 

W\r) = E log + log (6.12b) 

(6.12c) 



where (Tj G {1,2, ...A^} is the state of the system at time i. Both function- 
als have been defined by Lebowitz and Spohn, in [227], who focused on the 
properties of W, neglecting the importance of the difference B — W — W. 
Both W and W associate a real number to any finite trajectory (any real- 
ization of the Markov chain). In a stationary state which verifies the detailed 
balance condition fiaKab = f^bKba, one has W'{t) = 0, while W{t) ^ (ex- 
cept when Kab = Kba)- For t large enough, almost all the trajectories yield 
\\m.s^ooW{s)/s = \\m.,^^W'{s)/s = {W{t)/t) = {W'{t)/t), where (assuming 
an ergodic and stationary system) () indicates an average over many indepen- 
dent segments from a single very long trajectory. Let S = — Y^iLi log be 
the Gibbs entropy of the system at time t, where Vi{t) is the probability to be 
in the state i at time t; then 



S{t + 1) - S{t) = S(t) - A{t) (6.13) 

where E(i) is always non- negative, A{t) is a linear function with respect to 
u{t) = {uiit)}, and {W{t)) = {W'{t)) = J^dt'A{t'). In [227] this has been 
shown for continuous time Markov processes, but the proof is valid also in 
the discrete time case (see for example [228]). This leads to consider W{t) and 
W'{t) equivalent for the contribution of a single trajectory to the total entropy 
flux. In a stationary state A(t) — T,{t) and therefore the flux is equivalent to 
the production. For large enough t one has: 

(1) at equUibrium (i.e. when there is detailed balance) {W{t)) — {W'{t)) — 0; 

(2) out of equilibrium {W{t)) > and {W'{t)) > 0. 

Consider the fluctuations of the functional W. We flrst deflne an extended 
probability vector p{t,W), whose component Pi{t,W) is the probability of 
finding the system at time t in the state i, with value W for the Lebowitz and 
Spohn functional. This means that J2iPi(t,W) = f{t,W) is the probabflity 
density function at time t for the functional W, while / dWpi{t, W) = Ui{t) is 
the probabihty of finding the system in state i at time t and / dW J2i Pi{t: ~ 
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1. The evolution of p{t, W) is given by the following equation: 



(6.14) 



where K is the previously defined transition matrix and Awj^ is the variation 
of W due to a jump from the state i to the state ?'. This reads Awj,- = In 
Then define the function p(t, A) = / dVT exp(— Aiy)p(t, W) and obtain, for its 
evolution 



p(i + l,A) = A(A)p(i,A) 
A{\) being the matrix defined by 

A.(A) = K]r^K^, 

and, therefore, 

p(i. A) = A(A)*p(0, A) 
with pi(0. A) ^ J dW ex^{-\W)vi{<d)5{W) = ^/^(O). 



(6.15) 

(6.16) 
(6.17) 



The characteristic function of the distribution of W is obtained summing over 
all the states: 



The distribution of W at time t is recovered by inverting the Laplace trans- 
form: 

r+ioo 

(6.19) 



/+10O 
dAexp(Aiy)/(i,A). 
-ioo 



Furthermore, the knowledge of the characteristic function suffices to compute 
the moments or the cumulants of W: 



[-IT 



A=0 

log/>,A) 



(6.20a) 
(6.20b) 



A=0 



At large times, the evolution operator ^(A)* is dominated by the largest eigen- 
value yi(A) of ^(A). Defining yi(A) = exp(C(A)) it follows that 



p(t,A) -exp(C(A)t) 



/(t,A)=^p,(t,A)~exp(C(A)t) 



E4'Ha)z.,(0) 



x«(A) 



(6.21a) 



J:x\'\X), (6.21b) 
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where x(^)(A) is the eigenvector of A[X) associated to the largest eigenvalue 
yi{X). One expects, from the above large times behavior, an analogous large 
time behavior for the density distribution of W, i.e. 



f{t,W)= f ^"dAexp(Aiy)$:z/,(0)E[^(A)%- 

J « 

tmaxfAy + C(A)j = exp[tn{W/t)] (6.22) 



~ exp 

where we have introduced n^w) = limt^oo 7 log /(t, wt), the large deviation 
function associated with f{t, W), which is obtained as a Legendre transform 
of C(A), i.e. n{w) = \*w + ({X*) with ^C('^)|a=a* = -w, under the validity of 
the last chain of equalities. 



The previously defined Fluctuation Relation appears at this stage. In fact, 
it is evident that A{\) = A^{1 — A), being the transpose of A. This im- 
plies that ({\) = C(l — A) which suffices to get n{w) = tt{—w) + w, i.e. 
/(t, W) = f{t, —W) exp(W) at large times. The vahdity of the expansion 
in (6.22) is crucial for the validity of this relation, but it is not guaranteed 
when the integrand presents non-analyticities in the A complex plane. Such a 
catastrophe can happen, for example, when the number of states becomes 
infinite and the initial (final) probability /ij(j)(0) has some unbounded form 
(see below). The physical meaning of such a catastrophe is that the large 
fluctuations in the initial and flnal state cannot be neglected, because they 
contribute to the tails (i.e. the large deviations) of f{t, W) at all times. Note 
that the breaking of analyticity of f{t, A) is associated with large fluctuations 
of invariant probabilities. Many studies, including numerical simulations [226], 
analytical calculations [229,230,223] and heuristic arguments [231], show that 
the initial and flnal conflgurations modify the standard picture when the dis- 
tribution of the boundary term B = In //^(o) ~ In fj,^(t^ has exponential, or 
higher, tails in the stationary state. This may occur even if /li has Gaussian 
tails. 

Let us see what happens to the functional W which differs from W only 
for the non time-extensive term B, letting the prime denote quantities which 
involve this functional. For example, we denote the extended measure vector 
by p'{t,W') and the probability density function at time t by f'{t,W'), the 
characteristic function by f'{t, A), etc. The increment of the functional at each 
jump reads Aw^^- = Awijlog (^), recalling that //^ is the invariant measure 
for the state i. The evolution matrix therefore reads 

4^{X)=Kjr^K^^'l4, (6.23) 

and the evolution equation reads 

p'(t + l,A) = A'(A)pUA). (6.24) 
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The fundamental difference between W and the original W appears now. 
Since p'(0, A) = 1^(0), if one takes i/(0) = n (the system is in the stationary 
regime from the beginning), it happens that 

/'(I, A) = = EE^^.W/^.- = EE^r'^^/^j-V, (6.25) 



i.e. /'(I, A) = /'(1, 1 — A). By recursion, one realizes that this is the case for 
all times t, i.e. 

/>,A) = /Ul-A), (6.26) 
in general, which leads immediately to a finite-time symmetry relation 

fit, W) = fit, -W) eMW), (6.27) 

valid for any t. 

The functional W contains a term that cancels the effects of the fluctuations of 

the steady state measure, leading to a conservation of the symmetry A ^ 1 — A 
all along the evolution. Such a conservation prevents surprises at large times 
also in presence of large fluctuations of the initial measure. 

As an example of the above discussion [217], consider a Markov chain with 
N + 2 states, labeled A, B and Cj with i e {1, 2, ...A^} and with a transition 
matrix K deflned by 

^Paa Pab (1 - Paa - PAB)ki (1 - Paa - PAB)k2 ■■■ (1 - Paa - PAB)kN^ 

PBA il -pBA)kl il-pBA)k2 ■•• il-pBA)kN 

PC A 1 - PC A • • • 

PC A 1 - PC A • • • 

V ^ ^ J 

(6.28) 

with Y^iLi k'i = I, under the constraint that, for every jump of positive transi- 
tion probability, the reversed jump is also possible. The invariant probability 
/Lt for = 1 is given by 

Pba + PC A - PbaPca ^„ V 

Ha = (6.29a) 

1-PAA+ PcAiPAB + Paa - 1) 
Hb = -j^ (6.29b) 

1 - Paa - PabPba ,^ ^ 

He = (6.29c) 

with J\f^2+ pAAi-'2 + Pca) + PabPca - Pba(-1 + Pab + Pca)- 
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It can be easily seen that the invariant measure for A'^ > 1 is closely related 
to the case = 1 with a decomposition of the measure of state Ci into the 
measures of Cj proportional to the values kf 



(6.30) 



In numerical simulations of this model [217], the functionals W{t) and W'{t) 
can be measured along independent non-overlapping segments of duration 
T, extracted from a unique trajectory after the stationary regime has been 
achieved. Then, the following relation can be verified: 



where F{t,X) is the probability density function of finding one of the two 

functionals W or W after a time t equal to X (i.e. F{t,X) corresponds to 
/(t, W) or to f'(t, W) depending on the cases). Some typical results are shown 
in figures 16, which show the graph of vs x and the pdfs of W and W. 
The phenomenology can be divided in 3 main cases, depending on the choice 
of the transition rates. Whenever detailed balance is satisfied (here when A 
is disconnected from all Cj's, i.e. when pab = 1 — Paa and pcA = 0), W'{t) 
is identically zero and does not fiuctuate (its pdf is a delta in zero), as ex- 
pected, and therefore W{t) coincides with the opposite of the boundary term 
B = log^^: they both have symmetric fiuctuations around zero with expo- 



nential tails, and Gr = 0. When detailed balance is violated (i.e. when A is 
connected to all Cj's) both W{t) and W'{t) fiuctuate around a nonzero (pos- 
itive) value which, for r large enough, is the same for the two functions. In 
general the fiuctuations of the boundary term B = log have a pdf with 



exponential tails and the pdf of W is almost perfectly Gaussian. This is not 
true for the pdf of W. At small times (r = 100) the pdf of W resembles the 
pdf of B, evidencing that at this time W is completely dominated by At 
larger times the pdf of W and B start to deviate, in particular that of W tends 
to that of W in the bulk, with evidently different tails of exponential form. 
The tails of the pdf of W are always dominated by the fiuctuations of B. The 
symmetry relation for the functional W is not verified in any of these simula- 
tions, both at small and large times. The asymmetry Gt-{W) has a slope near 
1 only for small values oiW <^ {W), then deviates and saturates to a constant 
value in good agreement with the value 2(14^) predicted by van Zon and Co- 
hen [231]. Note that the observations at large times are perfectly compatible 
with those at small times, i.e. if both ordinates and abscissas are divided by r, 
the curves are similar (in the first two cases they overlap very well) . Therefore 
the "reduction" of the violation at large times is only apparent. On the other 
hand the symmetry relation for W is always satisfied, at all times and for all 
the choices of the parameters. Finally, when the choice of the rates ki is such 
that the invariant measure on states Cj is an exponential with a very high 
slope, the numerical results show that the fiuctuations of W are much closer 



Gr{X) = log F{t,X) - log F{t, -X) = X 



(6.31) 
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to those of W already at small times. This is reflected on the good agreement 
with the FR of both functionals W and W. One can still be doubtful about 
this veriflcation, because of the limited range of values of W available, which 
can possibly hide a failure at larger values. The distribution of the boundary 
term, in fact, still has exponential tails (invisible at our resolution) and it can 
be argued that these tails (being Gaussian those of W) will dominate at very 
large values. 




w, w w, w 

Fig. 16. Study of the boundary terms for the Fluctuation Relations in the Markov 
chain discussed in the text. Top graphs: probabilities of observing W (black squares), 
W (red circles) and B = W' — W (green lines). Bottom graphs: Gt{W) vs. W 
(black squares) and G-riW') vs. W (red circles). The dashed line has slope 1. The 
dotted horizontal line marks the van Zon and Cohen prediction for the FR violation, 
Gr{W) = 2{W) for large W [231]. The left column is at time r = 100 and the right 
column at time r = 1000. In the simulation we have used N = 50, paa = 0.2, 
PAB = 0.3, pba = 0.3 and pcA = 0.5 and ki oc exp{—ai) with the value of a given 
in the plot. In all cases {W{t)) = {W'{t)) = 0.0053r, i.e. 0.53 for r = 100 and 5.3 
for r = 1000. 



6.2 Numerical works 

An exhaustive account of the numerical works devoted to the study of FRs is 
practically impossible here, because of space limitations. Therefore, we briefly 
mention a selected group of works, and we concentrate only on two of them. 

The steady state FR for nonequilibrium systems was introduced and numeri- 
cally verifled by Evans et al. [148], in a model in which A = f2. After that, some 
numerical tests have been devoted to the A-FR, in order to understand the ex- 
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tent to which the Chaotic Hypothesis and the A-FR describe physical systems, 
see e.g. [232,183,233,234,156,235,198,197,236,237,158]. The result is that the 
A-FR is easily verified when A = il, while difficulties emerge when this is not 
the case. The largest group of tests concerns quantities related in various fash- 
ions to the entropy production or dissipated energy rates, both in transient 
and steady states, see e.g. Refs.[232,238,239,183,233,234,154,155,156,240,241]. 
It has been found that FRs for these physical observables are ubiquitously 
verified, in models of nonequilibrium fiuids. 



6.2.1 The nonequilibrium FPU chain 

Lepri et al. [242] modified the Fermi-Pasta-Ulam model, imposing nonequi- 
librium boundary conditions by means of two Nose-Hoover thermostats at 
different temperatures [238]. This work constitutes a numerical investigation 
of a steady state FR, meant to test the physical applicability of the relation 
in a model substantially different from the original one, i.e. in a solid rather 
than in a fluid. The test of [238] concerned the fluctuations of the heat flux, 
which verifled the FR, supporting the idea that such relations do have a quite 
wide range of applicability. 

The model studied in Ref.[238] consists of N anharmonic oscillators of mass 
m and positions Xj, j — 1,...,N, whose flrst and last oscillators {j — 1,N) 
interact with the left {£) and the right (r) thermostats, respectively, and with 
still walls, while all oscillators interact with their nearest neighbours through 
the potential: 

V{q) = y + > (6-32) 
where qj = Xj—ja is the displacement of the j'-th oscillator from its equilibrium 
position, and a is the equilibrium distance between two nearest neighbours. 
The equations of motion take the form 



^d^^' = PiQi - Qi-i) - F{Qi+i - Qi) , for i = 2, AT - 1 (6.33) 



N 



where go = Qn+i — 0, F — —dV/dz, 

and 6r, 9i are relaxation times which determine the efficiency of the ther- 
mostats. In the case that T^. ^ Ti, Eqs. (6.33,6.34) define the nonequilibrium 
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FPU-/? model, which is time reversal invariant, with time reversal operation 
defined by I{q,p, C) = {q, —p, —()■ The system is also dissipative, and the time 
average of the phase space contraction rate, {(^ + Q) , is positive. 

The authors argue that the heat flux J can be identifled, in this case, with the 
flux of potential energy. Then, they flnd that the average fluxes at the left, 
Jl, and right, Jr, ends of the chain are given by 

Jl,r = -{Cl,r)Tl,r, (6.35) 

where (Cl,r) is the mean value of the corresponding effective momentum of 
the thermostat. By subtracting from one another the fluxes in Eq. (6.35) and 
using the fact Jl = — Jr = J, on average, in the steady state, one obtains 

(A) = (Cl) + (Cr) = {J) - ^) ■ (6-36) 

This relation is analogous to the one for the global entropy production as 
obtained from linear response, but while it holds for the averages, the instan- 
taneous values and the fluctuations of A are not simply proportional to those 
of J. In Ref. [238], the steady state FR for J is tested and found to hold, 
even though the model does not enjoy normal energy transport, in the large 
N limit. This is not a contradiction in itself, although the validity of the FR, 
close to equilibrium, implies the validity of the Green-Kubo relations (5.61). 
The reason is that the nonequilibrium FPU chain at flnite A^, enjoys normal 
transport. The anomalous behaviour is reflected only in the divergence of the 
heat conductivity with growing N. 



6.2.2 Granular materials 

Some difficulties are encountered in experimental or numerical studies of the 
FR. An example from heated granular gases is discussed here. The theoretical 
analysis correctly predicts the asymptotic (large deviations, t — > oo) behavior 
of the fluctuations of the work done on the gas, but measurements done at 
flnite time lead to contrasting conclusions [243,244]. 

As already discussed in Sect. 4.3 and detailed in the Appendix A, a stan- 
dard way of modeling a granular gas is to consider a set of A^ hard-spheres 
undergoing inelastic collisions, in which a fraction (1 — r^) of the relative 
kinetic energy is dissipated. The restitution coefficient r lies between and 
1, where 1 corresponds to elastic collisions. The inelastic collision rule (A.l) 
breaks microscopic reversibility, i.e. for any given trajectory in phase space, 
the time-reversed one is not always physically realizable. One can write an 
energy balance equation for the total kinetic energy E{t) = J2i |vf , which 
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varies according to 



AE = E{t) - E{0) = W{t) - D{t) (6.37) 

where W{t) is the energy injected by an external driving mechanism, while 
D{t) > is the energy irreversibly dissipated by the inelastic collisions. The 
average variation rate of D can be estimated as the coUision rate times the 
energy dissipated through a collision, 

^(^) = -^(|vi2-^|^) (6.38) 

where £ is the mean free path, cr is the unit vector joining the centers of the 
colliding particles and Vi2 is their relative velocity. The mean kinetic energy 
per particle provides a typical energy scale, also termed granular temperature, 
and it is defined as 

T, = (v2)/rf = p;' , (6.39) 
where d is the spatial dimension. A typical heating mechanism is provided by 
Eq. (A. 2). We discuss here the monodisperse case which achieves a statistically 
stationary state, thanks to the injection of energy by means of independent 
random forces acting on each individual particle. This heating mechanism is 
easier to be handled mathematically and leads to a uniform stationary state. 
The work provided by the external source reads 

W{t)=J2 fdTr,,{T)-Vi{T) (6.40) 
. Jo 

Given that {W)/t — 2dr (where F is a parameter of the model, see Appendix 
A), the typical energy scale is set by Eq. (6.47). Following a procedure simi- 
lar to that of Section 6.1.1, we compute the large deviation function for the 
injected work W. 

Wc begin introducing a phase space density p(P, W, t) that counts the number 
of systems in state P (the A^-vclocitics phase space point) which, in the time 
window [0,t], accumulated a total work W{t) = W. A generalized Liouville 
equation can be written for p, in which the Liouville operator Cw can be split 
into a W conserving part, >Ccoii, and a part accounting for changes in W under 
the effect of the external injection mechanism jCmj'- 

dtp = Cw{P, W)p = £i„j(P, W)p + £eoii(P)p (6.41) 

It is convenient to introduce the Laplace transform of p, 

p(P,A,t) = y"dW^e-^^p(P,Py,t), (6.42) 
and rewrite the Liouville equation in terms of p, 

dtp = £w'(P, A)p = Anj(P, A)p + /:coii(P)p (6.43) 
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The largest eigenvalue //(A) of jCw{^) governs the asymptotic behavior of p, 

p(P, A, t) ~ C(A)e^(^)*p(P, A) (6.44) 

where p(P, A) is the (right) eigenvector of Cw(P, A), associated with /x(A), and 
C(A) is the projection of the initial state on this eigenvector. It is then possible 
to project on the single-particle distribution f^^\\-,X,t) = J (iPAr_ip(P, A, t). 
We arrive at 

dtf^''^ (v, A, t) = rAv/('^ + 2Arv • v/(^) + r{X^v^ - ciA)/(^) + Coll. (6.45) 

where in the rhs of (6.45) "CoU" is a shorthand for the collision operator 
which, resorting to the molecular chaos hypothesis, reads 

CoU.^i / dv2do-(vi2-a) (4/^^)(v!,A)/W(v;,A)-/W(vi,A)/W(v2,A)), 

(6.46) 

where \l and are the pre-collisional velocities, defined in the Appendix A. 
The steady velocity pdf equation (Boltzmann equation) is recovered at A = 0. 
The process encoded in (6.45) can be read off as the original granular gas 
dynamics in which additional particles are created when A > or annihilated 
when A < 0, at a velocity dependent rate Xv^. The largest eigenvalue of jCwi^), 
p{X) is then interpreted as the population growth rate. This remark was nu- 
merically exploited, for somewhat different systems in [245]. The splitting of 
/(^^ as a product of independent one particle distributions is indeed a kind of 
molecular chaos hypothesis, for the system with particle non-conserving ficti- 
tious dynamics. The Boltzmann equation toolbox offers many ways to deduce 
an expression for /i(A). The simplest approximation is to project /'-^)(v,A) 
onto a Gaussian with a A-dependent variance, denoted as T(A), as explained 
in [244]. 

Working in terms of rescaled quantities, with the granular temperature pre- 
cisely given by 

with = 27r'^/^/r((i/2), and performing the following substitutions 

p - P^ , A ^ AT, (6.48) 



MA) = -A + 1^A^ (6.49) 



one has: 



for the dimensionless quantities, where yT{X) sets the typical velocity scale for 
trajectories characterized by A. At large values of A, corresponding to values of 
W small with respect to (1^), we expect that T{X) <^ Tg and indeed ~ | 
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Fig. 18. Plot of TT{w,t) - 7r{-w,t) for 
t = 1,2 and 3 mean free times (mft). 
The inset shows the probabihty den- 
sity function of w{t) for the same 
times. 



Fig. 19. Plot of the third cumulant of 
W divided by time. The asymptotic 
regime is reached after fifty mft. 



as A — > +00 [243,244]. This can be further refined to obtain the behavior of 
/x(A) at A — >• +00, 

~ -A^/^ . (6.50) 

Besides, /^.(A) possesses a cut in the A-plane at Ac = —3/2^/^, such that, as 
A - A+, 

/i(A) = 3/2^/3 - 33/221/6^^ _ ^ Qi^x - Ae) (6.51) 

The presence of this cut is responsible for the exponential decay of the pdf 
of W at large values of W. However, the non-analytic behavior at A — > +00 
leads to a non-analytic behavior as w — W/t — > 0+, 

7r{w — >• 0"*") ~ —w~^^^ , 71(10 — > {w)) ~ —(-u;— 1)^/2 , 7r{w — >• 00) ~ —w 

(6.52) 
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Simulations of the granular gas heated with the stochastic thermostat [243,244] 
confirm the above results and thus the validity of these approximations. The 
total work W(t) provided by the random forces over [0, t] is of course, on aver- 
age, a positive quantity, but at finite times there exist phase space trajectories 
which yield a negative W. However, one of the key hypotheses underlying the 
Fluctuation Relation is that the dynamics features at least a weak form of 
time reversibility, for which trajectories (or ensembles of trajectories) possess 
time reversed counterparts (however unlikely). In our granular gas, dissipative 
collisions prevent time reversed trajectories to be physically acceptable tra- 
jectories at all. It should therefore be no surprise that no specific fluctuation 
relation holds in our case. This is confirmed by the explicit calculations pre- 
sented above, that show no specific symmetry property of the injected power 
large deviation function. In spite of this, it may be instructive to plot w vs. 
i In p^^l^l\-^ at possibly large times, since this is exactly 7r(w) — 7r(— w), being 
n{w,t) = |lnP(wt, t), in the infinite time limit. This is shown in figure 18: 
one actually observes a straight line with slope Pg, while the analytic results 
suggest the absence of such a straight line, even for values of w not too far 
from its average. In the first place, a numerical simulation is always carried 
out for finite times, and thus one measures 7r(w,t) rather than its t — >• oo 
limit, 7r(w). Though ^{w, t) deviates from a quadratic form, which would cor- 
respond to Gaussian P{W, t), this is no proof that the asymptotic regime has 
been reached. For that matter it is instructive to investigate the behavior of 
the third cumulant (W^) /t as a function of time, presented in figure 19. The 
conclusion is that the third cumulant reaches its asymptotic value, consistent 
with the analytic expression, at times a few tens as large as those for which 
negative values oi w — W/t can be measured, as shown in figure 18. A simi- 
lar plot of the fourth cumulant would signal that the asymptotic regime has 
not been reached over the chosen time window. What one actually observes is 
simply the remnant of a short time quadratic behavior for 7t{w). This is also 
consistent with the quadratic approximation for /x(A), which would indeed im- 
ply Tr{w) — Tr{—w) — PgW, after restoring the appropriate physical scales as in 
(6.48). 

6.3 Experimental works 

Experimental tests of FRs are usually rather delicate, because large fiuctua- 
tions are not directly observable in macroscopic systems. Therefore, one must 
either rely on the validity of local versions of the FRs, or consider small sys- 
tems, like micro-biological systems or nano-technological devices. Some exper- 
imental works on the FRs, and on similar relations are the following: 

• Ciliberto and Laroche's experiment [246] , for the temperature fiuctuations in 
a fluid undergoing Rayleigh-Benard convection. A linear law was observed. 
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but with a different (perliaps not asymptotic) slope. 

• Wang et al. experiments, for tlie transient and steady state fluctuations of 
work done on a colloidal particle, dragged through water by means of an 
optical trap, [165,247]. These experiments concerned nanoscale systems and 
motivated Ref.[165] 

• Feitosa and Mcnon's experiment on a mechanically driven inelastic granular 
gas in a fiuidized steady state [248]. They claimed a verification of a local 
version of FR, but their analysis has been criticized (cf. Section 6.3.1). 

• Garnier and Cihberto's experiment on the fluctuations of the dissipated 
power of an electric dipole [249]. They considered the work and heat fluc- 
tuations, both related with the fluctuations of the power dissipated by the 
resistor, and partly verified the Van Zon - Cohen scenario. 

• Shang et al. experiment on the fluctuations of a local entropy production in 
turbulent thermal convection [250]. They considered a cyhndrical cell filled 
with water of aspect ratio one, and verified the steady stat FR. 

• Ciliberto et al. experiment on turbulent flows, verified the local version of 
the FR, proposed in [182,183] 

• Douarche et al. experiment on the steady state and transient work fluctua- 
tions of a damped harmonic oscillator, kept out of equilibrium by an external 
force [251]. The transient FR was confirmed for any averaging time of the 
work. The steady-state version was observed to converge to the asymptotic 
behaviour. 

• Tietz et al. experiment on the entropy production in a single two-level sys- 
tem, a defect center in natural Ila-type diamond [252]. 

It must be noted that almost all of these experiments afford verifications of 
the FRs only to a certain degree, because various parameters of the relevant 
theories arc not accessible or controllable in them. Some authors even argue 
that a direct verification of the (steady state) FRs may be practically im- 
possible [253]. This opinion is likely too extreme, but the difficulty, so far, 
remains. Therefore, the observation of any approximately linear arrangement 
of data, with any slope, is often taken as sufficient evidence for the validity of 
the steady state relation, even if obtained for relatively short averaging times. 
Easier is the case of the transient relations. Because these relations are alge- 
braic "identities", which hold under almost no conditions, one may find odd 
that they are tested all, but there are at least two reasons for doing it. The 
first is to verify the relevance of the models for which these relations have been 
derived, to the physical reality. Indeed, those models have been devised and 
proved to be successful for certain purposes which, in general, are not those of 
the FRs, as recalled in Subsection 5.2. The second reason is that one can still 
rely on a few quantitative theoretical results, for the interpretation of certain 
nonequilibrium phenomena (protein stretching experiments, etc.). 

Despite the difficulty in gathering the necessary statistics, the transient rela- 
tions offer some of the few parameter-free quantitative predictions, which may 
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be used to infer equilibrium properties of certain systems, from nonequilibrium 
experiments. The Jarzynski and Crooks relations, in particular, have been 
tested in a good number of experiments including molecular and biophysical 
experiments. The reason is that this equality can be used to estimate the equi- 
librium free energy out of measurements of dissipated work in nonequilibrium 
processes. This is particularly useful in systems for which no other method 
to estimate the free energy exists. Douarche et al. experimentally confirmed 
both in [254]. An experiment for the colloidal particle in a time- dependent 
non-harmonic potential was reported by Blickle et al. [255]. The Jarzynski 
equality was first confirmed in 2002 by Liphardt et al. in measurements of the 
dissipated work in the folding-unfolding process of a single molecule of RNA 
[256]. Collin et al. experimentally confirmed the Crooks fiuctuation relation 
by pulling an RNA hairpin [257]. As discussed in detail in 6.3.2, using optical 
tweezers they measured the fiuctuations of the dissipative work during the 
unfolding and refolding of a small RNA molecule. Their measurements con- 
firmed the Crooks relation near and far from equilibrium. They also estimated 
the free energy from the nonequilibrium measurements. The nonequilibrium 
steady-state equality of Hatano and Sasa [220] has been verified by Trepag- 
nier et al. [258]. A detailed discussion of these experiments can be found in 
the review papers [259] and [142] . 



6.3.1 Experiments with granular gases 

Recently an experiment has been performed by Menon and Feitosa [248,260] 
using a granular gas shaken in a container at high frequency. The setup con- 
sisted of a 2D box containing N identical glass beads, vibrated at frequency 
/ and amplitude A. The authors observed the kinetic energy variations AEt, 
over time windows of duration r, in a central sub-region of the system charac- 
terized by an almost homogeneous temperature and density. They subdivided 
this variation into two contributions: 



where D^- is the energy dissipated in inelastic collisions and Wr is the energy 
fiux through the boundaries, due to the kinetic energy transported by incoming 
and outgoing particles. The authors of the experiment have conjectured that 
Wt, being a measure of injected power in the sub-system, can be related to 
the entropy flow or the entropy produced by the thermostat constituted by 
the rest of the gas (which is equal to the internal entropy production in the 
steady state). They have measured its pdf f{Wr) and found that 



AEr ^Wr-D. 



(6.53) 



In 



n-Wr) 



(6.54) 
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with (3 ^ i/Tg. By lack of a reasonable explanation for the value of (3, the 
authors have concluded to have experimentally verified the FR with an "effec- 
tive temperature" T^ff = suggesting its use as a possible non-equilibrium 
generalization of the usual granular temperature. The same results have been 
found in MD simulations of inelastic hard disks with a similar setup, see Fig- 
ure 20. There is a major objection to this reasoning: in the limit of zero inelas- 
ticity (i.e. in the case of ideal clastic grains) the pdf f{Wr) becomes symmetric 
with respect to the average injected power through the borders of the central 
region, which is 0, so that /3 — > and the effective temperature would diverge 
instead of coinciding with the equilibrium temperature. There is also a subtler 
problem in the interpretation of this experiment: from Equation (6.53), it can 
be argued that the large deviation function of f{Wr) equals the large deviation 
function of /(-Dr)- Recall that fiWr) ~ exp^rniWr/r)) when r — > oo, and 
that 7i{q) is the large deviation function of /{Wt), with q = Wr/r. Since D^- 
is always positive, it follows that the relation (6.54) cannot hold for r — > oo. 
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Fig. 20. a) pdfs of injected power fqiqr) from MD simulations for different values 
of r = (1, 2, 4, 8, 16, 32) x Tmin with Tmin = 0.015Tbox- Here = 270 and a = 0.9. 
The distributions are shifted vertically for clarity. The dashed lines put in evidence 
the exponential tails of the pdf at r = Tmin- b) plot of (1/r) log(/q(q,-)//q(— </,-)) 
vs. qr from MD simulations (same parameters as above) at large values of r. The 
solid curve is a linear fit (with slope Peff) of the data at r = 128Tmin- The dashed 

line has a slope I3gran = ^/Tgran 

A different explanation has been proposed in [260], which does not involve the 
FR but rather imputes the observed results to effects of finite time and poor 
statistics due to the limits of the measurement procedure. It appears that the 
injected power measured in the experiment can be written as 




(6.55) 



where n„ (resp. n+) is the number of particles leaving (resp. entering) the sub- 
region during the time r (with frequency a;), and vf_ {vf_^) are the squared 
moduli of their velocities. In order to analyze the statistics of Wr we take 
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n_ and n+ as Poisson-distributed random variables with average ujt, neglect- 
ing correlations among particles entering or leaving successively the central 
region. As supported by the direct observation of the simulation [260], the 
velocities Vj_|_ and Vj_ are assumed to originate from two distinct populations 
with different temperatures T+ and T_ respectively. Indeed, compared with 
the population entering the central region, the particles that leave it have 
suffered on avera ge m ore inelastic collisions, so that T_ < T+. Finally Gaus- 



sian velocity pdfsLlil are assumed. This allows one to calculate the generating 



function of f{Wr), obtaining g{z) = exp(r/i(z)) for any r, with 

/i(^) = a; (-2 + (1 - T+^)-^/2 ^ ^ T_^)-^/2^ , (6.56) 

which also automatically coincides with the large deviation function of g{z). 
We recall that the two large deviation functions fi{z) and n{q) are related by 
a Legendre transform. A FR with a slope (3 implies that fi{z) = — z) and 
this relation is not fulfilled by Eq. (6.56). It has, however, been observed [261] 
that 7r(g) — vr(— g) ^ 27r'(0)g + o(g^) at small values of q. This means that the 
linear relation (6.54) with jSe/f = 27r'(0) can be observed if the range of Wr 
is small, which is usually the case, since in experiments and simulations the 
statistics of negative events is very poor. From equation (6.56) a formula for 
the slope /? follows: 

with 7 = T+/T„ and 5 = 2/(2 + rf). When 7 = 1 (i.e. when the gas is elastic) 
Peff = 0. This formula is in good agreement with the slope observed in the 
simulations and in the experiment. 

The fact that expression (6.57) is in good quantitative agreement with the 
experiment is consistent with the observation of negative events, i.e. not too 
large r. We can thus argue that the experiment and the simulations have been 
performed over times large enough to test the validity of formula (6.57), but 
not so large that correlations may be disregarded. 



6.3.2 Applications of the Jarzynski relation to biophysical systems 

The second principle of thermodynamics implies that the free energy difference 
F{B) —F{A) between two equilibrium states A and B is smaller or equal than 
the work Wr done by the external force over the system during the A ^ B 
transformation taking a time r: 

Wr>AF = F{B)-F{A). (6.58) 



while non-Gaussian tails are quite common in granular gases, it has been checked 
that they play a negUgible role here 



117 



The equal sign applies only to infinitely slow transformations, i.e. r oo. 

For any finite r, even averaging over many realizations, say M, of the same 
experiment A ^ B, the measured (Wr) = J2iLi ^T,i is bound by the second 
principle to be larger than AF. 

The .Jarzynski equality (5.62) allows to measure AF by means of non-adiabatic 
transformations A ^ B, provided that the average (Wr) is replaced by a 
weighted average {Wr)j, i.e. the equal sign is always true in AF = {Wr)j 
with 



As noticed in Section 5.4.3, this argument reverses the link between equi- 
librium and non-equilibrium phenomena implied by the classical FDR. For 
instance, Green-Kubo formulas give a practical recipe to calculate transport 
coefficients from correlation functions in the unperturbed system, i.e. they ex- 
tract non-equilibrium properties from equilibrium ones. On the contrary, in 
the case of Eq. (6.59), an equilibrium property, AF, is obtained by means of 
non-equilibrium measurements. This is particularly useful in biology, where 
the reconstruction of the free-energy landscape of (large) complex molecules, 
such as proteins is crucial for determining folding pathways, the topology of 
the folded state, and the biological utility of the protein. The speed of a fair 
realization of reversibility along a reaction coordinate is determined by the re- 
laxation time of the protein, which can be very long: therefore a naive estimate 
of (Wr) would require an exceedingly large r. Before the Jarzynski relation, 
the only known correction to the rough estimate (WV) was [262] 

AF ^ AFfdr - {Wr) - Pay 2, (6.60) 

with (7^ the variance of WV, which is valid only near the reversible path, i.e. 
still for large r. This correction can be obtained from the FDR for Hamiltonian 
systems. A posteriori, from the Jarzynski relation, Eq. (6.60) is easily obtained, 
assuming that the distribution of Wr is Gaussian. 

The alternative provided by Eq. (6.59), suggested in [263] and experimentally 
tested in [256] for the first time, consists in performing M realizations of a 
pulling experiment on a single bio-molecule: the external force, provided by 
the cantilever of an Atomic Force Microscopy or by moving the laser trap 
of an optical tweezer (this was done in the real experiment), is applied to 
a terminal of the molecule, through a bead that plays the role of a handle, 
guiding the transformation from a folded A to an unfolded B state in a time 
r. Measures in numerical and real experiments have shown that the weighted 
average (6.59) can be effectively used to have a better estimate of AF with 
respect to AFfdr Eq. (6.60), for almost the whole range of displacements 



M 



1=1 



(6.59) 
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between A and B. Actually the applicability of Eq. (6.59) is not trivial, since 
a careful evaluation of all possible errors is required: reducing r allows to 
increase the number of experiments M, but at the same time makes wider 
and wider the distribution of WV and, therefore, more and more uncertain 
the estimate of the exponential average (exp(— /3VFt-)) through a finite sum. 
However it has been shown [264,265] that a range of r exists where the estimate 
is reliable. Moreover, this procedure has the advantage of providing a direct 
estimate of the statistical error of the measure, which is not possible with a 
small number of measurements and large r. On the other side, when applying a 
similar procedure to large systems, the difficulty arises that sampling negative 
Wr requires the number of independent experiments M to grow exponentially 
with the system size [266]. 



7 Large deviations and FR 

In Sections 2, 3 and 4 we discussed the properties of the mean responses, and 
their link with correlation functions. Sections 5 and 6 have been devoted to 
a more detailed statistical description of the probabihty distribution of time 
averages on certain intervals. Now, we want to treat at a more advanced level 
the statistical description of the time history of the system, as described by 
its observables. 

7. 1 Onsager-Machlup approach to fluctuations of thermodynamic variables 

As far as we know the first attempt in this direction was made by Onsager 
and Machlup, about half a century ago [267,268]. In two infiuential papers 
they studied the probability of a given succession of nonequilibrium states, 
of a spontaneously fluctuating thermodynamic system, under the assumption 
that the N variables {a} determining the state are Gaussian stochastic pro- 
cesses. Basically, Onsager and Machlup assume that the evolution of {a} is 
determined by a set of linear Langevin equations: 

^ da. r- 

2^ ^id-^T = - 2^ + V 2c?7i , (7.1) 

3=1 "''^ 3=1 

where {rj} is a white noise vector, i.e. a Gaussian process with < rjkit) >— 
and < '>]k{t)rij(t') >= S{t — t')5k,j- The symmetric matrices R = {Ri,j} and 
s = {si,j} determine the thermodynamic forces {X} and the entropy S{{a}): 

dS ^ 

i 7=1 
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In this approximation, one can express the entropy as 



S{{a}) = So - -Y^ Sijajai , 



(7.3) 



whereas the dissipation function is 

, 1 



and the corresponding entropy functional is 



(7.4) 



^ i,3 



3 ' 



(7.5) 

where the matrix L is defined by LX = da/dt i.e. L = R~^[fH Because 
of the Onsager reciprocal relations, the matrices L, R and s are symmetric 
(see section 2.4.3), and the Boltzmann principle implies that the invariant 
probability distribution is given by 



Pinv{{a}) oc exp [^({a})] oc exp ^ Sijajai 



(7.6) 



where we took ks = 1. The value of c in (7.1) is determined in such a way 
that Eq. (7.6) holds. Above we have used the original notation of the paper 
by Onsager and Machlup. In modern notation one would have 



dak 
dt 



N 



- Bj^kOij + v^?7fc k = 1 



,...,iV, 



(7.7) 



where now {r/} is a Gaussian process with < fjkit) >= and < rik{t)fjj{t') >= 
CkjS{t — t'). The link with the original notation, is given by B = R~^s and 
C = R 2. 

Let, for the sake of simplicity, = 1: 



da 
HI 



—7a + a/2c?7 



with 7 = s/R. The conditional probability density for a{ti] 
aito) = ao, is 



Pi{ai,ti\ao,tQ 



2nC{l - a(r) 



X exp — 



(Qi - a[T)ao} 
2C[1 - a(r)2 



(7.8) 
«!, given 

, (7.9) 



As stressed by many authors, e.g. ([267]), a thermodynamic description of a 
system requires an answer to the general question "/loif do you know you have 
taken enough variables, for it to be Markovianf For instance a noisy RC circuit is 
Markovian in the variables {q, q) but not for q (or q) alone. 
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where ti — to + t and 

a(r) = e"^^ , C = - = - . 

7 s 

Using the Markovian nature of the process, it is easy to determine the prob- 
abihty density of a discrete trajectory, a{ti) = ai,a{t2) = a2,---a{tn) — 
an---Oi{tM) — ckm, where tn — tQ + nr and aito) — a^. One gets 

M 

PM{ot{t\) = «!, Ot{tM) = OLmWo, to) = Yl Pl{<^n, ^nl^n-l, ^n-l) • (7-10) 

n=l 

In the hmit of small r, one obtains the rather transparent expression: 

Pi(Q;„,t„ = + T|Q;„_i,t„_i) = -^=1== X exp Qi„_i)T] , (7.11) 



where 

which leads to 



{an - an-i) , 



T 



^ 1 

, with D = C7 = - , (7.12) 



( 1 \ 

PM{ot{t\) = «!, a(*M) = Q;m|q;o, *o) = ^ 



M 
L n=l 

(7.13) 



The conditional probability distribution i-*i(Q;M, ^m|«0; ^o) can be obtained 
from (7.13), integrating over ai, 0:2, aju-i- Performing the limit r — > 
and M — >• 00 in such a way that tM = constant = t — to, one obtains 



Pi{a{t),t\a{to),to) = r^*^Pa(t')exp(- dt'C[a{t'),a{t')]\ (7.14) 



r«(i) 

where the Lagrangian function is 

2 



= ^(« + 7a) , (7.15) 



and the functional integral is defined in the usual way, i.e. 

pa{t) / 1 \M/2 f f f 

/ Va{t')Xt[{a{t')}] = lim — - da^ L / dQ!M^t[{Q!(ii), {a{ 

Ja{to) M^oo\4:7rJJTy J J J 

(7.16) 

for any functional Xt[{Q;(f )}]. 

The probability density of a path {a{t)} is 

P{{a{t')},to <t' <t)-^ expi^- J' dt'j[:[a{t'),a{t')]^ . (7.17) 
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Noting that 



= ^(^d + 7a) = + (7.18) 



one can recast (7.17) into 

P{{a{t')}, to<t'<t)r. exp |-i J^' dt\ct> + ^) + ]^[S{at) - 5(«o)]} ■ 

(7.19) 

This resuh plays a role analogous to the Boltzmann principle in nonequilib- 
rium statistical mechanics because it expresses the probability of a state in 
terms of its entropy. Here the probability of a sequence of states is expressed 
in terms of the entropy and of the dissipation function. 

The most probable value of a{t) is obtained minimizing dt'C[a{t'), a{t')]: 

dot 

— — —70; with Q;(io) = c^o (7.20) 
dt 

i.e. a{t) = a(0)e^'''*^*^*"''. In other words, the most probable value of a{t) 
coincides with the conditional average < a{t)\a{to) >. 

Analogously, the most probable path starting from ckq and ending in at is 
given by the minimum of /^'^ dt' C[a(t') , a(t')] with the constraints Q;(to) = ckq 
and a{t) = at- The minimum condition corresponds to 

[\<P + ilj)dt'] = 2 (S{at) - S{ao)) . (7.21) 

■J to J min V / 



The extension to > 2, does not present particular difficulties. For the case 
described by (7.7), the symmetry of the matrix C allows us to work in the 
diagonal representation of the white noise 77^, i.e. to deal with independent 
Markov processes. Therefore it suffices to replace the C in (7.15) for A" = 1 
with 

£{a,d) = ^Y.('^k + Y.^kjaj)^k,k'Uk' + (7.22) 
^^k,k'^ j ^ j ^ 

where A = C~^. In addition one has 

£(«, dc) = \ (0(a, a) + V^(X) - ^) , (7.23) 
and all the previous results hold for A^ > 1. 
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7.1.1 The non Gaussian case 



The generalization of the above results to the nonlinear case, i.e. 

^ fk{oc) + ^/2cnk A; = 1,...,7V, (7.24) 



dok 



where {77} is a Gaussian process with {r}k) = and {'>]k{t)'r]k'{t')) = Sk^k'^it — t'), 
is rather simple, at least at a formal level. Instead of (7.22), one obtains 

jC{a, «) = ^ X! - /fe) Ak,k' (afc' -/*;') ■ (7.25) 

k,k' V / V / 

A simple way to derive this result is the following: repeat the argument to 
obtain (7.13) for small r, and perform the path integral. Let us sketch the 
basic idea, for the one variable case: 

- = f(a) + V2-cn. 

Denote = a (to + nT) and write the above Langevin equation in its discrete 
time approximation: 

where are Gaussian random variables with = and {wnWn') = 5n,n'- 
Since the pdf of Wn is Gaussian, the generalization of (7.13) merely requires 
that ^ in (7.13) be replaced by 



£{an, Qin-l) = — 

4c 



{an - an-i) 



2 



The above procedure is heuristic and the result is not completely exact. Nev- 
ertheless it yields the leading term for small values of c. We do not discuss 
here this dehcate point, the interested reader can see [269,270]. 

The theory here outlined, for homogeneous systems, can be reformulated for 
spatially extended systems, as illustrated in the next subsections. 



7.2 Large deviations in extended nonequilibrium systems 



Various attempts have been made to extend Onsager-Machlup theory [267] to 
the large fluctuations of physical systems in nonequilibrium steady states [271]. 
Among them, the work by Jona-Lasinio and collaborators [272,167], is partic- 
ularly relevant to our discussion. Such approach generalizes those of Derrida et 
al. [273], and in addition it leads to an independent derivation of the FR. The 
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theory of [272,167] begins from the assumption that a hydro dynamic-hke de- 
scription of the system at hand is possible hence, physically, it can be applied 
as far from equilibrium as the validity of the local thermodynamic equilibrium 
allows. 
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The theory leads to the conclusion that the nonequilibrium entropy functional, 
which generalizes the Onsager-Machlup entropy to extended systems, is a non- 
local functional of the thermodynamic variables, hence that correlations are 
present over macroscopic scales. To illustrate these facts, consider stochastic 
models of interacting particles, whose number is locally conserved, in contact 
with particles reservoirs. Assume that these systems admit the hydrodynamic 
description 



dtQ = V 



(7.26) 



where g is the vector of macroscopic observables, x is the macroscopic space 
variable, t is the macroscopic time, D is the diffusion matrix. Equation (7.26) 
is analogous, in the spatially extended case, to Eq.(7.7) without noise. 

The mathematical theory is necessarily developed for very idealized models, 
such as the simple exclusion or the zero range stochastic processes] I Never- 
theless, the assumptions under which the theory holds are thought to be valid 
much more generally than in these cases, and are the following: 



Assumptions: 1) The mesoscopic evolution is given by a Markov process Xf, 
which represents the configuration of the system at time t. The nonequilibrium 
steady state is described by a probability measure Prob over the trajectories of 
Xt; 

2) the macroscopic description is given in terms of fields g which constitute the 
local thermodynamic variables, whose evolution is described by (7.26), which 
has a unique stationary solution g, under the given nonequilibrium boundary 
conditions; 

3) Denoting by I the time inversion operator defined by IXf = X_t, the proba- 
bility measure Prob*, describing the evolution of the time reversed process X^ , 
and Prob are related by 

Prob*(X; = (f)t,te [ti,t2]) = Prob(Xi = </)_i,t G ^2,-^1])- (7.27) 

This, of course, includes a very wide range of phenomena, well beyond the linear 
regime, which has quite wide applicability by itself. 

These models are usually one-dimensional. Their hydrodynamic limit consists of 
a scaling of the microscopic space and time variables, r and r, with the macroscopic 
space and time variables given hy t = t/N'^ and x = r/N, and the number of 
particles per unit length A'' tending to infinity. 
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Moreover, if L is the generator ofXt, the adjoint dynamics is generated by the 
adjoint (with respect to the invariant measure /j,) operator L* , which admits 
the adjoint hydrodynamic description 

dtg^V*{g), (7.28) 



4 ) The measure Prob admits a large deviation principle describing the fluc- 
tuations of Q, i.e. the probability for a large number N of particles that the 
evolution of the random variable qn deviates from the solution of (7.26), to 
follow a given path g{t), in the interval [ti,tf], goes like 

Prob {g^ (X^.,) ~ m, [U, tf]) ^ e-""' (7.29) 

where d is the spatial dimension, S{g{ti)) is the entropy cost to produce g{ti), 
and J is the extra cost required to follow the given path (taking S{g) = 0, J 
vanishes at g — g). 

This machinery leads to the following results: 

• The Onsagcr-Machlup theory is generalized by the introduction of the "ad- 
joint hydrodynamic" equation (7.28), for the spontaneous fluctuations around 
nonequilibrium steady states. Then, assuming that V can be decomposed 
as 

^(^) = ^V-(^x(^)v|^j+^ (7.30) 

where ^ is a vector field orthogonal to the thermodynamic force SS/6g (the 
functional derivative of the entropy with respect to the state), a temporal 
asymmetry arises in the fluctuation-relaxation paths. Indeed, a spontaneous 
fluctuation out of a nonequilibrium steady state follows a trajectory which 
is the time reversal of the relaxation path, according to the adjoint hydro- 
dynamics, i.e. it solves 

dtg = -V*{g) = -V{g) + 2A , (7.31) 

which is not merely the time reversal of the hydrodynamic equation. Being 
orthogonal to the thermodynamic force, the term that breaks the time sym- 
metry, A, is not the one that contributes to the entropy production. Note 
that Eq. (7.28) describes the adjoint hydrodynamics, while Eq. (7.31) refers 
to the evolution of spontaneous fluctuations. 

• A Hamilton- Jacobi type equation is given for the macroscopic entropy S{p). 
Expressing J as 

Jlu,t,]ig) = /*' dt Lim, dtm) (7.32) 

Jti 
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and introducing the Hamiltonian as the Legendre transform of C{q, dtg), 

n{g,Y) = sup y^Yd^-C{g,0] , 

the Hamilton- Jacobi type equation associated with the relation between S 
and J is 

W(..f)=0. (7.33) 

where S{g) = inf^ J[-oo,o](^) is computed over all trajectories g{t) connecting 
g to g. Then, the steady state satisfies 'H{g, 0) = 0. 

• An H-theorem is given for S: 

p<0. (7.34) 

• A nonequilibrium fluctuation dissipation relation holds: 

V{g)+V*{g)^W-(^x{Q)^^£) ■ (7-35) 

These results have been later generalized to the case of systems subjected to 
external bulk forces, like electric fields [167]. 



7.2.1 Temporal asymmetries in deterministic systems 

The question arises as to which aspects of the large deviation theory described 
above may be verified experimentally, or numerically tested in models other 
than the lattice gases for which it has been rigorously established. For instance, 
one usually assumes that the stochastic description is a redTiccd representation 
of some microscopic reversible dynamics, and should be recovered from that in 
some limit. However, various difficulties are to be faced, in order to answer that 
question. For instance, the dynamics of the Lorentz gas are proven equivalent 
to Markov processes, obtained by coarse graining with Markov partitions the 
relevant phase space [274]. On the other hand, the kind of stochastic process 
that one obtains depends on the particular form of graining, and concerns the 
phase space instead of the real space. Furthermore, it is not always possible 
to point out without ambiguities which quantities of the stochastic systems 
correspond to given quantities of the deterministic systems. Therefore, the 
identification of the deterministic dynamics which are consistent with a given 
stochastic process or, conversely, the identification of the stochastic processes 
which preserve the observable properties of given microscopic dynamics, is a 
rather difficult task, in general. 

This, on the one hand, indicates that a direct comparison between the predic- 
tions of Refs. [272, 167,166] and the fluctuations of deterministic particle sys- 
tems may be rather problematic, if not impossible, although desired [166]. At 
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the same time, the behaviour of a macroscopic system cannot depend on such 
subtle and subjective issues hke the form of the partitioning of the phase space; 
thus a test on deterministic systems of some aspect of the stochastic theory 
should be possible, in principle at least. Therefore, in Refs. [275,276,277] the 
prediction of the temporal asymmetries of fluctuations is tested, because the 
differences between hydrodynamics and adjoint hydrodynamics are largely re- 
sponsible for the other theoretical predictions, and because such asymmetries 
look amenable to direct test. It would be interesting to test, on deterministic 
systems, other features of the stochastic theory. 

The origin of the temporal asymmetry can be easily understood as follows. 
Consider the macroscopic deterministic dynamics described by 

j^Q = , (7.36) 

on M. C. IR^, where P is a vector field with a globally attracting fixed point 
g & Ai. The n components of g may represent the values taken by a scalar 
thermodynamic observable on the n different sites of a spatially discrete sys- 
tem. Let the local mesoscopic dynamics be a perturbation of Eq.(7.36), with a 
Gaussian noise of covariance (^j (t) {t')) = Kij6 (t — t') and mean {i{t)) = 0, 
where K is a symmetric, positive definite matrix: 



26 



|^ = P(f.)+e. (7.37) 

This allows different evolutions between one initial state gi = g (ti) and one 
later state gj = g(tf). The different paths connecting g^ to gj occur with 
different probabilities and Eq.(7.36) can be obtained from the maximization 
of probabilities of the form P oc exp(— Fj-^ j^,j(f?)), which depend on g^, gj and 
on the path connecting them: 



where the scalar product is defined by {x, y) = x^K.~^y, and the superscript 
T indicates transposition. Therefore, Eq.(7.37) is analogous to Eq.(7.7), and 
Eq.(7.38) corresponds to Eq.(7.22), with K"^ in place of A/2c. Now, decom- 
pose the vector field V as 

V{g) = -^KV,V{g)+A{g), with {KV,V,A) = 0, (7.39) 

where indicates differentiation with respect to the components of g, and 
let ^ be a minimum of V, with V{g) = 0, separating dissipative contributions 



Note that here we have adopted the convention of Ref.[272] for K, which misses 
a factor 2 with respect to more standard notation used in Section 7.1. 
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to T> from non-dissipative ones, as common in diffusion processes described 
by finite dimensional Langevin equations [270]. Substituting (7.39) in (7.38), 
one obtains 

which is minimized by the relaxational path converging to g and obeying 

j^g^-lKV,V{g)+A{g) , (7.41) 

i.e. obeying (7.36). However, the integrand of (7.40) is a quadratic form and 
has a second minimizing path, which is revealed by an integration by parts. 
This yields: 

+21V (s,) - V (s,)] (7.42) 

whose second term has no variation, once the initial and final states are fixed. 
Therefore, the second possible kind of evolution for g corresponds to the fluc- 
tuations away from g, which obey 

j^g = -V* {g) = ^K\/,V + A{g)^-V + 2A. (7.43) 

The qualitative properties of the deterministic dynamics do not depend on 
A, as the time derivative of the Lyapunov function V does not depend on A. 
Curiously, the asymmetry of the fluctuation paths depends only on this non 
dissipative term. 

In the hydrodynamic limit, T> becomes the elliptic differential operator of 
Eqs.(7.26,7.30), where K turns into V-x(f?)V, into the functional derivative 
d/dg and V{g) into S{g). In the theory developed by Onsager and Machlup, 
^ = because only the small fluctuations were considered, and the hnear 
response regime was assumed. 

The above suggests that sufficiently chaotic systems of interacting particles 
should typically have asymmetric ffuctuation paths. This has been indeed 
confirmed in [276,277] for the nonequilibrium FPU model, as well as for the 
shearing system of Eq.(5.2). In Ref.[276] it was then explained that the current 
ffuctuations of the many particles nonequilibrium Lorentz gas, studied in [275], 
had to be symmetric, as observed, because of the lack of interactions among 
those particles. It remains an open question to see which kinds of interactions 
lead to symmetric and which to asymmetric nonequilibrium fluctuation paths. 
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To properly deal with deterministic systems of finitely many particles, Refs. [275,276,277] 
introduced various notions of fluctuation-relaxation paths, together with vari- 
ous criteria to assess their asymmetry. In the following subsection, we consider 
only one of these notions, for the local heat flux of the nonequilibrium FPU 
model. 



1.2.2 Heat jiux fluctuation-relaxation paths in the FPU model 

An observable X : — > iR, for a system made of a finite number of particles, 
looks very noisy, in general. Therefore, given an initial condition F in the 
steady state, we search for the most likely path that starts at Xj. = X, reaches 
a certain fiuctuation value T{X) at time t, and later returns to X — Xt^. 
By path we mean the trajectory segment {Xf_^_^, r e [— 7b,To]} where, for 
simplicity, Xt denotes X(S'*F), and X is the corresponding time average of 
X. The time tq is a positive constant, that needs to be identified case by 
case, and represents the typical fiuctuation time. This notion may look odd, 
since a part of a given fiuctuation-relaxation path is sampled more than once 
(typically twice), but is appropriate to study the symmetry properties of paths, 
because it does not alter their symmetry, and does not neglect any of them. 
Furthermore, the results obtained so far are robust against variations of this 
definition [277,276]. 

Given n paths, they can be arranged to produce a two dimensional histogram, 
by partitioning the rectangle [— ro,ro] x [min^^^ Xj:'^-' . max^^gX^*)] with rectan- 
gular bins, and evaluating the frequency of visitation of each bin. The "crest" 
of the histogram represents the most likely path in the sample, the one which 
should become the unique (deterministic) path in the large system limit. In 
[276] , a number M of tests is performed, each producing a different histogram 
and a different crest, so that the maximum, minimum and average crests can 
be defined as follows. Let t G [— tq, tq] and j = 1, M be the index of the 
crest, then, denoting by the crest produced in the j-th test, 

1 M 

Cav{t) = -Y^CKt) (7.44) 



is the average crest; 

is the minimum crest, and 



C(t)=^.miii^C'(t) (7.45) 



C{t)^ m^^^a{t) (7.46) 



is the maximum crest. 

To assess the symmetry properties of a crest C, discretize the time interval 
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Fig. 21. Crest of the heat flux / for an FPU chain with N = 66, Ti = 70, Tr = 20, 
/ ~ 16.2, and T ~ 148. The highest Une represents C, the intermediate hne repre- 
sents Cav , and the lowest hne represents C. Each hne is the overlap of the four crests 
obtained with M = 39, 59, 79, 99. 

[0, To] in br sub-intervals, and introduce the asymmetry coefficient as 

MC) = J I E C{p)-±C{p) \ , (7.47) 

where, the normalizing factors are introduced only for convenience. A crest is 
called symmetric if its asymmetry coefficient vanishes. The asymmetry coeffi- 
cients can take positive as well as negative values, and random oscillations of 
a fluctuation path around its symmetric relaxation image result in a vanishing 
asymmetry coefficient. With these definitions, and M = 20, the heat flux in a 
central portion of the chain, of the nonequilibrium FPU model, with = 150 
oscillators, produces results like 

«c(C) = 0.170 , «,(C,,) = 0.194 , ac(C) = 0.211 

for a large temperature difference between the ends of the chain (T^ = 200 
and Tr = 20), and for a fluctuation value T three standard deviations higher 
than the mean. Here, the gap between the maximum and minimum crests 
asymmetries can be taken as the numerical uncertainty on the asymmetry 
of the crest. The result is that temporally asymmetric fluctuation- relaxation 
paths are found in time reversal invariant dynamics. Figure 21 illustrates these 
facts for a chain with fewer oscillators, for which a relatively large number 
of tests can be performed. In this case, it is interesting to see that the three 
kinds of crests do not appreciably change when the number of tests grows over 
M = 20, which is an indication of the accuracy achieved in the construction 
of the crests. In Ref. [278], a justification of the ubiquity of the temporally 
asymmetric fluctuation-relaxation paths, in nonequilibrium particle systems. 
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is given in terms of correlation functions. 

1.3 The additivity principle 

The theory developed in Refs. [272,167] has a non-local nature, as easily under- 
stood in the works of Derrida and collaborators [273,166], who independently 
worked out the explicit solutions of what can now be seen as specific examples 
of the theory of [272,167]. Actually, explicitly computing the large deviation 
functional of the current in systems like the symmetric and asymmetric simple 
exclusion processes, Bodineau and Derrida realized that a certain additivity 
principle describes the corresponding steady states. 

The idea is the following: let a one dimensional system have length L + L' and 
be in contact with two reservoirs of particles at densities Qa and Qi,. Express 
the probability of the current integrated in a time t, Qt = jt say, as 

ProhL+L'U, Qa, Qb) ~ e-*^^+^'(^'^-^'') . (7.48) 

Then, the additivity principle relates -Fl+l' to the large deviation functional 
of the subsystems of sizes L and L', by taking 

ProhL+L'U: Qa: Qb) ~ Hiax {ProbL(j, Qa, ^)ProbL/(j, g, Qb)} . (7.49) 

i 



Pal \ ^Pb 

L ' L' 

Fig. 22. Sketch of a one-dimensional system between two reservoirs pa and ph, which 
is virtually divided into two sub-systems of length L and L' respectively. An average 
current j flows through the system (assuming for instance that pa > Pb)- 

In other words, one assumes that the probability of transporting j between the 
reservoirs at densities Qa and q^, is the maximum over q of the probabilities of 

transporting the same currents between two reservoirs at densities Qa and q, 
times the probabilities of transporting it between two reservoirs at densities 
Q and Qb- Then, in the large system limit, in which boundary contributions 
become negligible, the relevant large deviation functional takes the form 

Fl+l'U: Qa: Qb) = max{FL(j, Qa, q) + Fi'^j, Q, Qb)} ■ (7.50) 

In the case of nonequilibrium boundary conditions (i.e. Qa ^ Qb), this results 
in a non-local relation for the steady state density profile, as shown in the next 
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subsection for an exactly solvable model. Introducing the scaling hypothesis 

FlU^ Qa, Qb) ^ Qb) (7.51) 

and observing that the optimal profile connecting Qa to qi, is the same for both 
j and —J, in the steady state, Bodineau and Derrida obtain also the validity 
of the FR for the current j, in the form 

Dig) 

G{-j, Qa, Qb) = G{j, Qa, Qb) - 2j / — — dg (7.52) 

where D{g) and a{g),m the large L limit, are defined as follows: let Qa — ^»+A^ 
and gi, — g, with small A^, then {Qt)/t — D{g)Ag/L and {QD/t — a{g)/L. 



7.3.1 The symmetric simple exclusion process 

The symmetric simple exclusion process affords one of the few nonequilibrium 
systems for which the large deviation function of the density can be computed 
in an explicit way. This model consists of a 1-dimensional lattice with L sites, 
which can be either empty or occupied by one particle. At each time step, of 
length At every particle can jump with equal probability At to the right, if 
the site on the right is empty, or to the left, if the site on the left is empty. At 
the left boundary of the lattice (site 1), particles are injected with probability 
aAt, if 1 is empty, and are removed with probability jAt, if 1 is occupied. 
Similarly, at the right boundary (site L), particles are injected with probability 
SAt and removed with probability f3At. This is equivalent to have a reservoir of 
particles at density ga = a/(«+7) on the left, and one of density gb = S/{S+f3) 
on the right of the lattice. Therefore, if = 0, 1 is the random variable equal 
to when site i is empty, and equal to 1 when it is occupied, one obtains 



"^^^1^ ^a-{a + ^ + l){n) + {t2) (7.53) 



dt 

d{r,) 

dt 

d{TL) 



= (ri_i) - 2{Ti) + (r,+i) , 2 < i < L - 1 (7.54) 
^{rL-i)-(5 + (3 + l){TL) + 5 . (7.55) 



dt 

The steady state, which corresponds to vanishing derivatives, takes the form 



and the current takes the form 



Qa - Qb 



J-{r.- = . , . (7.57) 



a 5 
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which is proportional to the gradient {ga — Qb)/L, when L ^ 1, Qa/a, Qb/S. At 
equihbrium, with Qa = Qb = and in the large L limit, if the lattice has unit 
length, the large deviation functional takes the form 



1 1 

B[Q[x)^Q)(ix^ with B{q^ g) = [1 — Q)\og 



+ Qiog- . 

I- Q Q 

(7.58) 

The functional is thus a local function of q{x), and is convex. Let us note that 
B{q, q) is nothing but the Creamer's function corresponding to the binomial 
distribution, see Appendix B. Differently, in the nonequilibrium case, Qa ^ Qb, 
one has 



Jo 

where / is the monotone solution of 

/(I - /)/" 



B{g{x)J{x)) +log 



fix) 



Qb - Qa 



Q-f + 



f 



12 



m = Qa , /(I) = Qb 



(7.59) 



(7.60) 



This result, which was first obtained in [279] and, later, as a special case of 
the theory of [272], shows that the value of / at position x depends on the 
profile g{y) at all points y, hence that F is non-local. 



8 Conclusions 



In this report we have summarized the history and the state of the art of 
the studies concerning the response of physical systems to external actions. 
This has evidenced how the statistical mechanics community has gradually 
shifted its focus from the investigation of equilibrium and near equilibrium 
phenomena, to strongly nonequilibrium phenomena, which cannot be under- 
stood in terms of thermodynamic quantities. Similarly, the interest has moved 
from the construction of a microscopic interpretation of the macroscopic phe- 
nomena, for which the thermodynamic limit of finite systems is necessary, to 
the study of the properties of mesoscopic and microscopic objects, which can 
be understood as systems of finitely many microscopic components. These 
objects are presently under intense investigation, because they appear to be 
extremely interesting from both fundamental and applied viewpoints. From 
the applied viewpoint, it is important to understand their behaviour, because 
of the emerging nanotechnology, which impacts also on our ability to manipu- 
late biological systems. From the fundamental point of view, it is now obvious 
that they must be described by phenomenological equations which differ from 
those of the macroscopic world. But the classification of the phenomena which 
are possible at the mesoscopic and microscopic level is still to be done, and a 
consistent theory of such phenomena is still lacking. 
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Nevertheless, the body of knowledge acquired in the past century, in the con- 
struction of the microscopic theory of the response of macroscopic systems, 
appears to be an ideal springboard to decisively leap into the largely unex- 
plored realm of strongly nonequilibrium systems, and of microscopic objects. 
Indeed, this knowledge has been based on the characterization of the fluc- 
tuations which, although macroscopically not observable, are evident if the 
thermodynamic limit is not taken. This is why we believe that a review of 
the response theory stretching up to present times, with emphasis on non- 
standard issues (granular media, fluids, nano-systems and biological systems), 
was needed and should be useful in advancing our understanding of the phys- 
ical world. 
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A Appendix: Models of granuleir gcises 

The most common model of fluidized granular matter is the gas of inelastic 
hard spheres in d dimensions (reviews of recent results can be found in [280] 
and [281]), interacting through binary inelastic coUisions. Initially the N par- 
ticles are placed in a box of volume V = U\ at random positions and with 
random velocities, typically taken from a Gaussian distribution. Since we dis- 
cuss monodisperse as well as bidisperse systems, we denote by Sj, cxj and rrii 
respectively the species, the diameter and the mass of particle i. The use of 
(7 and m without indexes will denote the monodisperse case. When particles 
i and j collide, the instantaneous change of their velocities is given by 

Vi = Vi - (1 + Tij) ^ [{vi - Vj) ■ aij]aij (A.l) 

where rij e [0, 1] is the restitution coefficient, rrii and rrij are the masses of the 
particles and iTy is the unit vector joining the centers of the particles. When 
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Tij — 1 the gas is elastic and no energy is dissipated in the colhsions. In aU 
other cases the colhsions are dissipative. Different kinds of experimental setups 
can be reproduced by this model, provided that a suitable driving mechanism 
is added. A widely accepted model for the investigation of strongly fluidized 
granular gases, reduces the effect of the interaction between the grains and 
the fluidizing agent (e.g. an air flow or random collisions with the vibrating 
plate) to that of a "thermal" bath coupled to every particle. Between collisions, 
the particles are subjected to a random force given by white noise, with the 
possible addition of a viscous term. The equation of motion for a particle is 
then 

m,^ = Ff+Vi-ls,yi (A.2) 

where F?°' is the force due to inelastic colhsions, is the viscosity coefficient 
of species Sj and r)i is the Gaussian stochastic force, with {T]ia{t)r]jp{t')) — 
Vl.5ij5ai35{t — t'), where the Greek indices refer to Cartesian coordinates. The 
granular temperature of species s is given by its mean kinetic energy T| = 
ms{v'^)s/d where ()s is an average restricted only to particles of species s. This 
definition is important in view of the lack of energy equipartition observed in 
granular mixtures. 

From the generic equation of motion (A.2), many different models can be 
obtained. When 71 = 72 = 7, Fi = r2 = F, rn = ri2 = r22 — r, and all 
the particles are identical, the gas is monodisperse. The "coohng granular 
gas" is recovered when 7 = F = [113]. In such a case the particles follow 
ballistic trajectories until they collide and lose energy. The kinetic energy of 
the particles in their center of mass frame decreases with time, justifying the 
term "cooling" . The homogeneous cooling is an idealized situation obtained 
when the positions of the particles are disregarded [113]. This situation is 
considered the analogous of the perfect rarefied gas in the realm of granular 
matter. For this model an equation for the evolution of the single particle 
velocity pdf /(v, t) can be written, in the form [282] 

(dt + vV)f(v,t)^J[f,f](v,t), (A.3) 

where, in the Boltzmann-Grad limit, the collision operator J, for hard spheres, 
takes the form: 

J[fJ]{yut) ^- f dV2d0-(vi2-0-) (4/(vt,i)/(v;,i) -/(Vi,i)/(v2,t)) 

(A.4) 

In this last expression, the relative velocity V12 = vi — V2 has been used, as 
well as the pre-collisional velocities v^f, V2 which can be obtained from vi, V2 
inverting the colhsion rule (A.l) for particles 1 and 2. 

When F 7^ the effect of external random forces balances the energy dissipated 
in collisions, and a statistically stationary state is reached. Two possibilities 
have been considered in the literature: 
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• the heat bath with viscosity [133,134,135,136], i.e. 7 7^ 0: in this case a 
"bath temperature" can be defined as T5 = r^/27. This corresponds to 
the temperature of a gas obeying equation (A. 2) with elastic collisions or 
without collisions. The same temperature can be observed if the viscosity 
is very high, i.e. when 7 ^ 1/tc where Tc is the mean free time between 
colUsions; when 7 -C I/tc and r < 1 the gas still reaches a stationary regime, 
but its granular temperature is in general smaller than and, therefore, 
the system is out of equilibrium [283] ; 

• the heat bath without viscosity [137,138,139], i.e. 7 = 0; in this case to 
obtain the correct elastic limit one must reduce the driving intensity F ~ 
1 — as r — > 1, so that the average kinetic energy per particle and per 
degree of freedom Tg does not diverge. 

These two models show a rich range of phenomena, that are usually observed 
in driven granular gases. The statistical properties of the stationary state ob- 
tained by those models are different from those of an elastic gas in contact with 
a thermal bath: the most important difference is that the velocity distribution 
is non-Gaussian with enhanced high-energy tails [282]. The other typical fea- 
ture is that the inelastic collisions reduce the relative velocity of particles and 
make re-collisions more likely: this is a source of correlations which emerges 
in the form of density clusters and velocity parallelization (vortices and other 
structures [134,138,139]). The hydrodynamic transport coefficients for these 
models have been calculated from the Chapman-Enskog approximated solu- 
tion of the Boltzmann equation in [284], while an analytical study of the 
Einstein relation can be found in [119]. 

Other models can be derived from the previous ones. A useful approxima- 
tion is the so-called Direct Simulation Monte Carlo, or DSMC [285,286,287], 
which consists in disregarding the relative position of particles in order to 
drastically reduce the probability of a re-collision: this is usually considered 
to be equivalent to the Molecular Chaos assumption in the N ^ 00 limit . 
Here, we consider the uniform gas. This model is nonetheless useful to test 
also spatial effects, see for example [134,286]. In this case the collisions occur 
with a probability which is proportional to the relative velocity of the parti- 
cles, in order to be consistent with the kernel of the colhsion integral of the 
Boltzmann equation (A. 4). A further simplification is operated in the so-called 
Inelastic Maxwell Models (see [124,125] and references therein). These models 
are gases of inelastic particles without positions, where collisions occur with 
a constant probability, i.e. not dependent upon the relative velocity. They are 
inspired by the so-called Maxwell Molecules, an elastic kinetic model having 
the same property due to the particular inter-particle (soft core) potential. 
Inelastic Maxwell Models have a very simple Boltzmann equation that can be 
analytically solved in the one dimensional case [124,125]. Other properties can 
be obtained in an analytical form, for example it is possible to demonstrate a 
general relation between the response R{t) of a particle to the sudden pertur- 
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bation of its velocity at time 0, with a very large set of correlation functions, 
including the self-correlation [117,118]: 

with any generic function / of the initial velocity value. 



B Appendix: Leirge Deviations in a nutshell 



For the sake of self-consistency, we briefly discuss the basic aspects of the 
Large Deviations theory. Roughly speaking, one can say that the Large Devi- 
ations theory is a generalization of the two most important limit theorems of 
probability theory, i.e. the law of large numbers, and the central limit theo- 
rem [288,289]. 

Consider a simple example: a sequence of independent tosses of an unfair coin. 
The possible outcomes are head (-1-1) or tail (—1). Denote the possible result 
of the n-th toss by Xn, where head has probability a, and tail has probability 
1 — a. Let Fjv be the mean value after N tosses, 

1 ^ 

^^ = ^E^n. (B.l) 

n=l 

li N ^ 1, a straightforward application of the central limit theorem gives 

N(Y-(Y))^ 

Prob{Y <Yn <Y + dY) PN{Y)dY ~ e ^ — dY , (B.2) 

where (Y) = 2a — 1, = 4q;(1 — a), Pn{Y) is the pdf of the random variable 
(B.l). Since Yn lies between —1 and I, it is easy to reahze that (B.2) is 
accurate only for small deviations of Y^ from the mean (namely \Yn — {Y)\ < 
Oil/VN)). 

A natural way to introduce the large deviations and show their deep relation 
with the concept of entropy is to perform a combinatorial computation. The 
number of ways in which K heads occur in N tosses is N\/[K\{N — K)]], 
therefore, the exact binomial distribution yields 

Prob(Y, = f - 1) = - af-- . (B.3) 

Using Stirling's approximation and writing K = pN and N — K = [1 — p)N 
one obtains 

Pn{Y = 2p - 1) ~ e-^-^("'f) , (B.4) 

where 

7(q;,p) =pln^ + (l-p)ln^^ . (B.5) 
a 1 — a 
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Note that I{q,p) is called "relative entropy" (or KuUback-Leibler divergence), 
and I{a.p) = for a = p, while I{a,p) > for a p. It is easy to re- 
peat the argument for the multinomial case, where Xi, ...,xi\f are independent 
variables that take m possible different values ai, 02, with probabilities 
TTi, 7r2, TT^. In the limit N ^ 1, the probability of observing the frequencies 
fi, f2, fm is 

where 

i=i 

is called "relative entropy" of the probability {p}, with respect to the proba- 
bility {71} . Such a quantity measures the discrepancy between {p} and {n} in 
the sense that I{{p}, {tt}) = if and only if {p} — {tt}, and I{{p}, {tt}) > 
if M ^ {tt}. 

Prom the above computation one understands that it is possible to go beyond 
the central limit theory, and to estimate the statistical features of extreme 
(or tail) events, as the number of observations grows without bounds. Writing 
I{p, a) in terms of Y — 2p — 1, Eq. (B.4) becomes 

Pn{Y) ^ e-^^(^) , (B.6) 

with 

1+Y 1+Y 1-Y l-Y 
S{Y)^^——hi^—— + - ^In- 



2 2a 2 2(1-0;) 

The function S(Y) is called Cramer's function. Of course, for p close to a, i.e. 
Y ~ (y), a Taylor expansion reproduces the central limit theorem (B.2). 

However Eq. (B.6) has a general validity, and can be derived in different ways, 
which show how the shape of S {Y) is related to the behaviour of the moments 
of the variable x. In particular it is possible to see that S{Y) can be expressed 
in terms of a Legendre transform: 



S{Y) = sup 



qY - L{q) 



(B.7) 



where L{q) is the "Cumulants Generating Function" given by 

L{q) = ln(e«^) . (B.8) 

Let us sketch the argument. Consider the quantities (e^^^^) which can be 
written in two ways: 

(e«^^^) ^ Je'i''''^PM{Y^)dY^ ~ J el-'^-^^^^l^cir (B.IO) 
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whose identification leads to 

j ^[qY-s(Y)]N^Y r^e'^'^^'i^ (B.ll) 

and, in the hmit of large N , using the steepest descent method, one has 



L(g) = sup 



y 



qY - S{Y) 



[B.12) 



which is the inverse of ((B.7)). Since it is possible to show that S(Y) is convex. 
Equations (B.7) and (B.12) are fully equivalent. 

For the more general and interesting case of dependent variables, L(g) is de- 
fined as 

L(g)= hm l^e^S"^!^'") , 

N—^oo iV 

and (B.7) is exact if S{Y) is convex, otherwise Eq. (B.7) gives the convex 
envelop of the correct S{Y). 

Let us note that the Cramer function must obey some constraints: 

a) SiY) > for r 7^ {¥)■ 

b) S{Y) = for r = \y)- 

c) S{Y) ~ (r - (r))V(2(T2), where = {{x - {x)f), if Y is close to (F). 
Of course a) and b) are consequences of the law of large numbers, and c) is 
nothing but the central limit theorem. A mathematical introduction to the 
Large Deviation theory is given in [288]. 



C Appendix: Anosov systems 



Anosov systems play an important pedagogical role, in the theory of dynamical 
systems: their behaviour is highly chaotic and rich in structure. The celebrated 
Arnold cat map, defined by 

Vn+l J \ 1 "^J \yn 

on the unit square TVI = [0, 1] x [0, 1], belong to this classic 

Although they can be understood in rather simple terms, they are quite effec- 
tive in expressing the concept of deterministic chaos. Anosov dynamics can 
be discrete (Anosov diffeomorphisms) or continuous (Anosov flows), and are 
defined on smooth manifolds Ai (the phase space). Anosov diffeomorphisms 
and flows are not completely equivalent, although from a flow one may always 

Because of the mod operation, the Arnold cat map is not a linear map. 



mod 1 



(C.l) 



139 



extract a map, observing the contiiiTious time dynamics at discrete instants of 
time. Here, we limit our attention to properties which are similar in the two 
cases, presenting the general theory for continuous time systems, since physi- 
cal systems mostly have continuous time, and illustrating it on the Arnold cat 
map, which can be explicitly worked out in detail. 

For simplicity, assume that the dynamics explores densely Ai, i.e. that it is 
transitive. Then, the main feature of an Anosov system is that Ai is hyperbolic, 
i.e. that for all X e A4, the tangent space TxA4 continuously splits in a stable, 
an unstable and a neutral linear space [290], E^, EJ^ and E^ respectively. The 
tangent space of a flow at a point X E Ai can be interpreted as the space of 
all possible velocities at that point. Indeed, the evolution remains in Ai, hence 
these velocities can only be tangent to Ai in that point, and constitute a linear 
space of dimension equal to the dimension of A4. The points in TxAi are then 
also called tangent vectors. More precisely, let DS*{X) be the Jacobian map of 
the transformation S"* (which evolves any initial condition X into Xf = S^X) 
evaluated at the point X. Clearly, DS^{X) depends on both t and X. Then, 
for a flow, transitivity and hyperbolicity mean that: 

a) TxAi — Ex ® Ex ® Ex is continuous (or smooth) in X, i.e. in any coor- 
dinate chart, the components of a constant vector field are continuous (or 
smooth) functions of the coordinates of the point X. E\ is a one-dimensional 
linear subspace in case of flows, while it reduces to {0} in case is a map. 

b) The linear subspaces Ex and Ex are invariant with respect to the tangent 
(or Jacobian) map DS*, i.e. for all X e DS\X)E^x = ^nd 
DS\X)E^ = E^t(x)- 

c) There exist C > and 1 > > 0, such that for all t G M, we have 
II DS\X)^ ||< C^*|| Cll, for alU e E'x and || DS-\X)rj ||< C^* || ||, for 
all yrieE^. 

The tangent space at X may also be seen as the space which contains the 
inflnitesimal perturbations 6X = X' — X of the initial point of a given trajec- 
tory, that produce nearby trajectories. Because X and X' lie in A4, because 
Ai is assumed to be smooth, hence to have a tangent in X, and because SX 
is infinitesimal, 5X lies in this tangent space, of dimension equal to that of 
Ai. The tangent vectors evolve according to the rule DS^{X)SX , hence con- 
dition c) implies that they all grow or decrease at exponential rates, which are 
everywhere bounded away from zero, except for the tangent vectors directed 
along the neutral space. 

Furthermore, transitive Anosov systems enjoy the following properties [290,291]: 
(1) the stable and unstable manifolds 

W^^{X' eM: lim \\S*X' - S^X\\ = 0} 

t— >oo 
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= {X' e M : lim \\S-'X' - S-'X\\ = 0} 

are globally defined and dense in Ai, for every X E Ai (transitivity); 

(2) periodic orbits are dense in ^A] 

(3) there is an invariant measure /i which represents the statistics of the for- 
ward time evolution, and which has a density along the unstable direc- 
tions. Such a measure is usually called Sinai- Ruelle-Bowen (SRB) measure 
and satisfies 



hm i r^S'X) = f = ($) 

T^oo I Jo J 



for (Lebesgue) almost all X G A^. For maps, the same holds, if the time 
integral is replaced by a sum over time steps. 

Thanks to property (2), fi can be represented in terms of orbital measures. 
If P (T,T + e] is the set of the unstable periodic orbits of the system, with 
period r G (T, T + e], for a fixed e > and for any T > 0, the following holds 
[292] 

Theorem:Let {M,S^) be an Anosov flow (with E C^). Let $ G , and 
let j be an unstable periodic orbit of period Tj. For any Xj G j, denote by J" 
the Jacobian of the dynamics restricted to the unstable manifold, with initial 
condition Xj. Then, for all e > 0, 

($) = lim ^^^^(^.^+-1^ f\ ) lL_ (C.2) 

where Xj is any point in the orbit j. 

A version of Eq.(C.2) is available for maps, and is formally identical to (C.2): 
it suffices to replace the integrals by sums. It is interesting to note that ($) is 
obtained as a weighted average of orbital averages, with weights 

iJ-r'-Tj (C.3) 

which have the suggestive form "inverse of instability x period": i.e. one orbit 
contributes more than another to ($) if it has larger period, but contributes 
less if it is more unstable. Furthermore, it has been observed that the neigh- 
bourhoods of the periodic orbits of a given interval of periods afford, at least 
in some systems, a hierarchical tessellation of the phase space, which is finer 
where fi is higher [293]. This should yield a rather quick convergence of the 
hmit in (C.2), because the low period orbits cover the parts of phase space 
which have higher probability, leaving to the long period ones the task to 



This theorem holds more generally for Axiom- A systems, which may have a finite 
number of attracting sets. 
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cover even the less probable parts. However, Eq.(C.2) has proved highly non- 
trivial to use for practical computations, and it has been tested and used only 
in low-dimensional systems, such as the Lorentz gas [294,295]. This does not 
prevent the use of that formula for theoretical calculations, hence various re- 
sults of statistical mechanics interest have been obtained through it (see, e.g. 
[190,296,191]). Furthermore, it was the use of such weights that led the au- 
thors of [148] to propose the fi-FR (which happened to coincide with the A-FR 
in their case). This is why the mathematical formulation of the A-FR given 
by Gallavotti and Cohen was based on the Chaotic Hypothesis, i.e. on the 
hypothesis that systems of physical interest behave as if they were transitive 
Anosov systems. 

All the above is easily illustrated by means of the Arnold cat map. Being a 
diffeomorphism, it has no neutral direction, and its tangent space at any point 
X e A4 is TxM. — IR^. The eigenvalues and the eigenvectors of the matrix 
defining the map are A"'* = (3 ± -\/5) /2, and 




(C.4) 



where is the golden ratio. Therefore, points that lie close to (0,0), in the 
straight line of slope passing through the point (0, 0) remain in that line and 
their distance grows by a factor (p at each iteration. When these points cross the 
boundary of the unit square, they re-enter the square from the opposite side, 
and continue to move on a line of same slope, while their distance continues to 
grow by the same factor, except for the effect produced by the mod operation. 
Therefore, the infinite line of slope 0, passing through (0,0), cut and moved 
by the mod 1 operation, constitutes the unstable manifold of the point (0, 0). 
Similarly, the fine of slope — passing through (0,0), cut and moved by 
the mod 1 operation, constitutes the stable manifold of (0,0), because its 
points are moved along that direction, while their distances are reduced by 
the factor at every iteration of the map. Similarly, one finds that each 
point X e has stable and unstable manifolds which are the straight lines 
of slopes and — passing through X, mod 1. The exponential growth 
and decrease of the sizes of the tangent vectors are precisely the factors and 
because the tangent vectors are linear combinations of and f*. The 
density of the unstable manifold of the point (0, 0), in the Arnold cat map, is 
easily understood observing that its slope is irrational. Therefore, if one thinks 
of it as the trajectory of a point particle, which moves at constant velocity, 
exits the square at given instants of times, and re-enters the square form the 
opposite side, one realizes that it can never re-enter at a point which has been 
previously visited. In other words, this trajectory, i.e. the unstable manifold, 
wraps around densely exploring all of Ai. The invariant SRB measure is the 
Lebesgue measure d/i — dxdy, and the density of the periodic orbits follows 
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from the fact that the pieces of stable and unstable manifolds of a point 
intersect forming a grid (called Markov partition), whose cells have invariant 
borders, inside each of which there are periodic points. Because the manifolds 
are dense, hence can form arbitrarily fine grids, the density of the periodic 
points follows. To find the periodic points of period n, one must solve the 
equation 



For instance, (0, 0) is a fixed point, hence it is periodic of all periods. All the 
periodic orbits are unstable, because of the ubiquitous hyperbolic structure. 

Normally, the Anosov systems that are considered to illustrate the idea of 
chaos in physics are low dimensional, like the Arnold cat, because their dimen- 
sionality is not particularly important for their statistical properties. These 
properties are due to the uniform hyperbolicity, i.e. to the violent and ubiq- 
uitous trend of the trajectories to separate at an exponential rate, which pro- 
duces an extremely high degree of mixing in the phase space. This makes 
possible to formally obtain in low dimensional Anosov dynamics certain prop- 
erties that are expected to hold in thermodynamic systems, like the symmetry 
of Onsager relations [189]. Obviously, the physical content of that symmetry in 
a system of one particle is totally different from the content of that symmetry 
in a thermodynamic system, and is obtained for completely different reasons. 
Adding that hardly any system of physical interest is of the Anosov kind, 
that the phase space dynamics is not the real space dynamics, and recalling 
the meaning of the statistical laws, as expressed e.g. in [141], cf. Sect. 4. 4.1, 
leads to the conclusion that some care must be used in describing physical 
phenomena by means of Anosov systems. 



D Appendix: A pedagogical example 

It is very instructive, also from a pedagogical point of view, to work out, 
for a system simple enough, the connection between some of the results dis- 
cussed in Sections 5, 6 and 7. We closely follow a recent interesting paper 
by Astumian [297], which considers the overdamped dynamics of a colloidal 
particle immersed in a fluid with viscosity 7, subject to a conservative force 
Fc = —U\x) and pulled by a non-conservative force Fncit) = g{t)F(.xt- The 
position X of the particle obeys the Langevin equation 



where F{t) = F^ + Fnc{t), rjit) is a Gaussian white noise. This is also the 
equation that governs the process of pulling a terminal of a macromolecule 




mod 1 



(C.5) 




(D.l) 
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anchored to a surface and surrounded by water; this system has been studied 
in recent experiments [256,265]. 



Following the discussion of Onsager-Machlup theory in Sec. 7.1,, in particular 
the non-linear generalization of Par. 7.1.1, one can obtain the probability 
density of a path starting at time and ending at time t. Again it is sufficient 
to consider discrete times to + kr with r arbitrarily small and k G [0, n] 
with n being the integer part of {t — to)/T. Since the noise is Gaussian and 
delta-correlated, the sequence of variables rjk — rj{to + kr) has the probability 
density 

P[(r7„, |r/o, 0)] ocexp (^-^E^^j (D.2) 
which, in the limit r — > 0, becomes 

P[(r/„,t|... 1^0,0)] ocexp(-^^*(iV(s)) • (D.3) 

Equation (D.l) tells us that r){t) = (f - F/j)/V2D, with D = T/j, which 
finally gives us 

P[{7?(i)}]ocexp(-L), (D.4) 

where 



AD Jo \ds 7 y 27D AD Jo 



is the thermodynamic action, 

Wextiivi't)}] = J^ds lFnc{s) 




is the work done by the external forcing Fnc{t) and AU — — /^J Fc{x)dx is 
the difference of potential between the final and the initial position. To find 
the most probable path from (a;o,0) to (xf,t), it is sufficient to minimize the 
action (D.5) while keeping fixed the endpoints. Note that to obtain, from 
Eq. (D.4), the correct probability density for the trajectories x{t), one has 
to calculate the Jacobian of the transformation 77 (t) — > x{t). Anyway, even 
disregarding this problem, many interesting results discussed in this review 
can already be reproduced. 

• A difference (asymmetry) between the probability of a path {?7(t)} and its 
time-reversed {Ir]{t)}, follows from the fact that the last integral in (D.5) 
does not change sign upon applying the time-reversal operator /. This cor- 
responds, in this example, to the asymmetry of paths discussed in 7.2.1. Of 
course the richness of the recent results in Sections 7.2 and 7.3 (such as the 
non- locality of the entropy functional), which concerns spatially extended 
systems (fields) cannot be reproduced by this example. 
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The ratio between the probabihty density of a path and that of its time- 
reversed reads: 

which, for large times, allows one to identify the work w^xt done by the 
external non-conservative force (divided by ksT) as the entropy produced 
during the time t. This is an example of the result by Kurchan [164] and by 
Lebowitz and Spohn [227] on the FR for stochastic systems. Even without 
referring to the FR, Eq. (D.7) is interesting because the r.h.s. does not 
depend explicitly on time. 

By a simple calculation it is immediate to see that 



P{wext[v{t)] = -W) " \hT 



which is the FR for stochastic systems. 
Finally, one has 



(D.9) 

which is nothing but the Jarzynski relation, or the partition identity, in this 
steady state case. 
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